Ultrasonic imaging apparatus and method

Abstract

To realize an image provision service that can meet various needs of pregnant women; and reduce a burden on a creator in creating an image collection that includes fetal images.SOLUTION: If the existence of a past fetal image corresponding to a current fetal image is determined, a basic layout is added to a layout candidate list (S12). When the existence of a related image related to the current fetal image is determined, an optional layout is added to the layout candidate list (S12). An image collection including the current representative fetal image is created according to a layout candidate selected from the layout candidate list (S18).SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present disclosure relates to an ultrasonic image processing apparatus and method, and particularly to the creation of an ultrasonic image set.

Background Art

[0002] Ultrasonic examinations are regularly performed on fetuses in the mother's body. An ultrasonic diagnostic apparatus is used for ultrasonic examinations of fetuses. Recently, in ultrasonic examinations of fetuses, the use of ultrasonic diagnostic apparatuses equipped with a three-dimensional image formation function has been increasing. One of the reasons is the spread of the service of providing three-dimensional images that stereoscopically represent the fetus to pregnant women.

[0003] Patent Document 1 describes an ultrasonic diagnostic apparatus that simultaneously displays an ultrasonic image of a fetus and a graph showing the fetal growth process. Patent Document 2 describes an ultrasonic diagnostic apparatus having an enlarged printing mode. Patent Documents 1 and 2 do not describe technologies related to proposals for layouts for outputting a plurality of images.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] An object of the present disclosure is to realize an image providing service that can satisfy various needs of pregnant women. Alternatively, an object of the present invention is to reduce the burden on creators when creating an image set including fetal images.

Means for Solving the Problems

[0006] The ultrasonic image processing apparatus relating to this disclosure is The image processing unit includes an image processing unit, and the image processing unit is A selection means for selecting the current fetal image obtained from the current ultrasound examination of the fetus as the primary output target; a first determination means for investigating the image database and determining whether or not there are past fetal images obtained from past ultrasound examinations of the fetus; a first addition means for adding a basic layout for assigning the current fetal image and the past fetal image to a layout candidate list if the existence of the past fetal image is determined to exist; a second determination means for investigating the image database and determining whether or not there are related images other than the past fetal image that are related to the current fetal image; a second addition means for adding an optional layout for assigning the current fetal image and the related image to the layout candidate list if the existence of the related image is determined to exist; and from the layout candidate list... By the user Includes an output means that outputs an image collection that follows a selected layout and includes the current fetal image. nothing, It is characterized by the following:

[0007] The ultrasonic image processing method relating to this disclosure is: The process includes an image processing step, and the image processing step is: The process involves selecting the current fetal image obtained from the current ultrasound examination of the fetus as the primary output target; investigating the image database and determining whether past fetal images obtained from past ultrasound examinations of the fetus exist; if the existence of past fetal images is determined, adding a basic layout for allocating the current fetal image and the past fetal images to the layout candidate list; investigating the image database and determining whether related images other than the past fetal images that are related to the current fetal image exist; if the existence of related images is determined, adding an optional layout for allocating the current fetal image and the related images to the layout candidate list; and selecting from the layout candidate list By the user The process includes outputting an image collection that follows a selected layout and includes the current fetal image. nothing, It is characterized by the following: [Effects of the Invention]

[0008] This disclosure enables the realization of an image provision service that can meet the various needs of pregnant women. Alternatively, this disclosure aims to reduce the burden on creators when creating image collections that include fetal images. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing an example configuration of an ultrasound diagnostic apparatus according to an embodiment. [Figure 2] This is a diagram showing the main table for image management. [Figure 3] This figure shows the first example of a subtable for image management. [Figure 4] This figure shows a second example of a subtable for image management. [Figure 5] This figure shows a list of images obtained from current ultrasound examinations. [Figure 6] This figure shows a list of images obtained from past ultrasound examinations. [Figure 7] This is a flowchart showing an example of the operation. [Figure 8] This figure shows a specific example of S12 shown in Figure 1. [Figure 9] This is a diagram showing multiple basic layouts. [Figure 10] This diagram shows multiple option layouts. [Figure 11] This figure shows an example of an image collection created according to the basic layout. [Figure 12] This figure shows an example of an image collection created according to a layout for multiple births. [Figure 13] This figure shows an example of an image collection created according to a layout for inserting reference images. [Figure 14] This figure shows an example of an image collection created according to a layout for inserting external images. [Figure 15] This figure shows the first example of an image collection created according to an information image insertion layout. [Figure 16]This is a diagram showing a second example of an image collection created according to the layout for information image insertion. [Figure 17] This is a diagram showing an example of a layout candidate list.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments will be described based on the drawings.

[0011] (1) Outline of the Embodiment The ultrasonic image processing apparatus according to the embodiment includes a selection unit, a first determination unit, a first addition unit, a second determination unit, a second addition unit, and an output unit. The selection unit selects the current fetal image obtained in the current ultrasonic examination of the fetus as the main output target. The first determination unit investigates the image database and determines the existence of past fetal images obtained in past ultrasonic examinations of the fetus. The first addition unit adds a basic layout for allocating the current fetal image and the past fetal image to the layout candidate list when the existence of the past fetal image is determined. The second determination unit investigates the image database and determines the existence of related images other than the past fetal images and related to the current fetal image. The second addition unit adds an optional layout for allocating the current fetal image and the related image to the layout candidate list when the existence of the related image is determined. The output unit outputs an image collection including the current fetal image according to the layout selected from the layout candidate list.

[0012] Each layout candidate added to the layout candidate list corresponds to an outputable image set. The selection of the layout from the layout candidate list corresponds to the selection of the output target (image set). Therefore, according to the above configuration, a plurality of currently selectable image sets can be recognized, and a desired image set can be easily selected from these image sets. Thereby, the needs of pregnant women can be satisfied, or the quality of the image providing service can be improved. Also, the burden on the user can be significantly reduced in providing the image set.

[0013] The basic layout is for creating an image collection consisting of multiple fetal images showing the developmental stages of the fetus being examined. The optional layout is for creating an image collection consisting of fetal images of the examined fetus and related images. Related images can include a variety of images to suit the diverse needs of the pregnant woman. Multiple selectable optional layouts may be added to the layout candidate list.

[0014] The concept of an ultrasound image processing device includes ultrasound diagnostic devices, information processing devices, etc. The concept of output means includes printers, data recording devices, data transfer units, etc. Related images are secondary output targets identified based on the primary output target. The image processing unit, described later, functions as a selection means, a first determination means, a first addition means, a second determination means, a second addition means, etc.

[0015] In one embodiment, the first determination means determines the number of past fetal images obtained from multiple past ultrasound examinations of the fetus if the image database contains such images. Based on that number, the determination means determines the allocation pattern in the basic layout.

[0016] According to the above configuration, the allocation pattern is automatically determined according to the number of past fetal images output together with the current fetal image. Therefore, the user does not need to specify the allocation pattern. The automatically determined allocation pattern may be modified by the user afterward. An upper limit may be set on the number of fetal images that can be allocated. The image processing unit described later functions as the determination means.

[0017] The ultrasound image processing apparatus according to this embodiment includes means for adding gestational age information to each fetal image assigned according to the basic layout when a basic layout is selected from a list of layout candidates. With this configuration, the acquisition time (i.e., the examination time) of each fetal image can be identified, and the growth of the fetus can be accurately grasped.

[0018] In this embodiment, the multiple fetal images, which are allocated according to the basic layout, are each three-dimensional images generated based on volume data acquired from within the mother's body. Other ultrasound images, such as tomographic images, may also be allocated.

[0019] In this embodiment, the related images include fetal images of other fetuses in a multiple relationship with the fetus currently under consideration, and the optional layout includes a layout for multiple fetuses. This configuration makes it easy to create an image collection containing multiple fetal images of multiple fetuses in a multiple relationship.

[0020] In this embodiment, the associated image includes a reference image generated by processing the current fetal image, and the optional layout includes a layout for assigning the current fetal image and the reference image. With this configuration, the current fetal image can be observed while referring to the reference image.

[0021] In this embodiment, the associated images include external images provided by the pregnant woman, and the optional layout includes a layout for allocating the current fetal image and the external images. This configuration allows for the creation of an image collection including external images. Examples of external images include images of the pregnant woman, images of family members, etc. External images are usually non-ultrasound images. When allocating external images, size adjustments or other modifications may be performed on the external images.

[0022] In this embodiment, the associated image includes an informational image containing the results of measurements taken on the fetus, and the optional layout includes a layout for assigning the current fetal image and the informational image. With this configuration, the fetal image can be observed while referring to the measurement results. Examples of informational images include an image containing a graph showing the trend of the measured values, an image containing an examination report containing the measured values, and so on.

[0023] The ultrasound image processing method according to the embodiment comprises a selection step, a first determination step, a first addition step, a second determination step, a second addition step, and an output step. In the selection step, the current fetal image acquired in the current ultrasound examination of the fetus is selected as the main output target. In the first determination step, the image database is searched to determine whether or not past fetal images acquired in past ultrasound examinations of the fetus exist. In the first addition step, if the existence of past fetal images is determined, a basic layout for assigning the current fetal image and past fetal images is added to the layout candidate list. In the second determination step, the image database is searched to determine whether or not related images other than past fetal images that are related to the current fetal image exist, based on the fetal identification information or the current fetal image. In the second addition step, if the existence of related images is determined, an optional layout for assigning the current fetal image and related images is added to the layout candidate list. In the output step, an image collection that includes the current fetal image is output, according to the layout selected from the layout candidate list.

[0024] The above ultrasound image processing method is implemented by hardware functions or software functions. In the latter case, a program for implementing the above ultrasound image processing method is installed on an information processing device via a network or a portable storage medium. The information processing device has a storage medium for non-temporarily storing the program. The concept of an information processing device includes ultrasound image processing devices, ultrasound diagnostic devices, etc.

[0025] (2) Details of the embodiment Figure 1 shows an example of the configuration of an ultrasound diagnostic apparatus according to an embodiment. An ultrasound diagnostic apparatus is a device installed in a medical institution or the like for performing ultrasound examinations, and specifically, it is a medical device that forms an ultrasound image based on the received signal obtained by transmitting and receiving ultrasound. An ultrasound diagnostic apparatus is an ultrasound image processing device.

[0026] In this embodiment, the subject is a pregnant woman as the mother. Specifically, the object of the ultrasound examination is the fetus inside the mother's womb. The transmitting and receiving surfaces of the ultrasound probe 10 are brought into contact with the upper surface of the pregnant woman's abdomen. In this state, ultrasound waves are transmitted and reflected waves are received by the ultrasound probe 10.

[0027] The ultrasonic probe 10 has a vibrating element array (2D vibrating element array) consisting of multiple vibrating elements arranged in two dimensions. An ultrasonic beam is formed by the 2D vibrating element array, and this ultrasonic beam is scanned in two dimensions. This creates a three-dimensional data acquisition area within the subject. Volume data is acquired from the three-dimensional data acquisition area. Alternatively, the 2D vibrating element array may form a beam scanning surface, which is the two-dimensional data acquisition area. In that case, received frame data is acquired from the beam scanning surface.

[0028] The transmitting unit 12 is an electronic circuit that, during transmission, supplies multiple transmission signals in parallel to the vibrating element array. This causes ultrasound to be emitted into the living body, thus forming a transmission beam. During reception, when reflected waves from within the living body are received by the vibrating element array, multiple received signals are output in parallel from the vibrating element array to the receiving unit 14. The receiving unit 14 is a receiving circuit that generates received beam data by phase-correcting summation (delay summation) of the multiple received signals input in parallel.

[0029] The volume data described above consists of multiple received beam data points arranged in the first and second electron scanning directions. Each individual received beam data point consists of multiple echo data points arranged in the depth direction. The frame data described above consists of multiple received beam data points arranged in the first electron scanning direction, for example.

[0030] A plurality of image forming units are provided downstream of the receiving unit 14. In Figure 1, the tomographic image forming unit 16 and the three-dimensional image forming unit 18 are shown among them. The tomographic image forming unit 16 is a module that forms a tomographic image from received frame data or volume data. Specifically, the tomographic image is a B-mode tomographic image.

[0031] The three-dimensional image forming unit 18 is a module that applies volume rendering to volume data to form a three-dimensional image. More specifically, the three-dimensional image is a two-dimensional image that represents a fetus in three dimensions.

[0032] The information processing unit 20 functions as an arithmetic control unit and is comprised of a processor that executes programs. Specifically, the information processing unit 20 is comprised of a CPU. The information processing unit 20 has the function of controlling the operation of each component shown in Figure 1. The information processing unit 20 also has measurement functions, data management functions, and image processing functions. These functions are represented in Figure 1 as the measurement unit 40, the data management unit 42, and the image processing unit 44. The image processing unit 44 can also be called the image collection creation unit. Modules such as the tomographic image forming unit 16 and the three-dimensional image forming unit 18 may be comprised of processors.

[0033] The information processing unit 20 is connected to a storage unit 22, an operation panel 24, a display 26, a recording and playback device 28, a printer 30, a communication unit 31, and the like. The storage unit 22 is composed of semiconductor memory, a hard disk, etc. In the illustrated example configuration, the storage unit 22 stores a group of tables 32, a group of ultrasound images 34, a group of inspection reports 38, etc. Measurement data is also stored in the storage unit 22, but the illustration of the measurement data is omitted in Figure 1. The storage unit 22 as a whole corresponds to an image database.

[0034] Table group 32 includes the main table and several subtables, which will be described later. Ultrasound image group 34 includes sets of ultrasound images acquired for each ultrasound examination of a pregnant woman. Each set of ultrasound images typically includes multiple tomographic images and multiple three-dimensional images. Each of these images represents the fetus.

[0035] Typically, multiple measurements are taken of the fetus during each ultrasound examination, resulting in several measurement values. The examination report created after each ultrasound includes these multiple measurements, as well as the fetal ultrasound image, findings entered by the examiner, and other relevant information. Based on the examination report, an image representing the report is created.

[0036] The control panel 24 includes a trackball, multiple switches, a keyboard, a touchscreen panel, etc. The display unit 26 displays ultrasound images. In this embodiment, the display unit 26 also displays a layout candidate list and an image collection. The display unit 26 is composed of a liquid crystal display, an organic EL display device, etc. The image collection can be printed using the printer 30. The printed image collection is given to the pregnant woman. The recording / playback device 28 is a device that reads data from a portable storage medium and records data to a portable storage medium. A DVD recorder or the like may be used as the recording / playback device. The storage medium containing the image collection is given to the pregnant woman. External images provided by the pregnant woman may be stored in the storage unit 22 via the recording / playback device 28.

[0037] The communication unit 31 is for exchanging data with other devices. For example, a series of ultrasound images may be transferred to an information processing device such as a computer, and an image collection may be created in that information processing device. External images from an external device may also be acquired through the communication unit 31.

[0038] The measurement unit 40 performs measurements based on ultrasound images. Measurements include distance measurement, area measurement, etc. Multiple measurements are performed on multiple parts of the fetus. The fetal weight may be estimated based on the multiple measurement values ​​obtained from these measurements. In that case, the fetal weight is also a measurement value. The data management unit 42 manages the multiple images stored in the storage unit 22.

[0039] The image processing unit 44 creates an image collection after each ultrasound examination, as needed. The image collection includes a fetal image selected from among multiple fetal images acquired during the current ultrasound examination. This fetal image can be called the current representative fetal image. The current representative fetal image is, for example, the last three-dimensional image acquired during the current ultrasound examination. The user may also specify the current representative fetal image from among the group of fetal images acquired during the current ultrasound examination. In addition to the current representative fetal image, the image collection includes one or more past representative fetal images and related images related to the fetus examined.

[0040] The image processing unit 44 generates a layout candidate list containing one or more layout candidates that can be selected by the user, and presents it to the user. The image processing unit 44 creates an image set according to the layout selected from the layout candidate list. The selection of a layout corresponds to the selection of an image set. When creating the layout candidate list, one or more image sets may be created. That is, each layout candidate may be an image set itself. In that case, the user is presented with a layout candidate list containing one or more image sets.

[0041] Figure 2 shows the main table 50 for image management. The main table 50 contains multiple records 52 corresponding to multiple subjects (multiple pregnant women). Each record 52 contains information such as patient ID, patient name, last examination date, gestational age (GA), number of fetuses, subtable, etc. The number of fetuses is the number of fetuses constituting a multiple birth. The specific contents of the subtable (1A2B) for one subject are shown in Figure 3. The specific contents of the subtable (3C4D) for another subject are shown in Figure 4.

[0042] In Figure 3, subtable 54 consists of multiple records 56 corresponding to multiple images. Each record 56 contains information such as image identifier, examination date, storage time, GA, image type, fetal identifier, etc. Regarding image type, 2D indicates a tomographic image, and 3D indicates a three-dimensional image. Graph indicates a graph image, and Report indicates an examination report image. Regarding graphics, Yes means that it is a reference image generated by processing the ultrasound image (an ultrasound image with a graphic superimposed), and No indicates that it is a normal ultrasound image.

[0043] In Figure 4, subtable 58 consists of multiple records 60 corresponding to multiple images. Each record 60 contains information such as an image identifier, examination date, storage time, GA, image type, fetal identifier, etc., similar to record 56 shown in Figure 3. FetusA and FetusB represent fetus A and fetus B, which are twins. A multiple fetal identifier may also be included within record 60.

[0044] Figure 5 shows image 70 displayed on the display screen, which includes an image list 72. The image list 72 represents multiple ultrasound images acquired during the current ultrasound examination. From these ultrasound images, the user selects a specific ultrasound image. This selects the specific ultrasound image as the primary output target. The specification or selection of the output target may be performed automatically. For example, the three-dimensional image acquired at the end of the current ultrasound examination may be automatically determined as the output target.

[0045] Figure 6 shows an image 74 displayed on the display screen. Image 74 includes a patient list 76 and an image list 80. The patient list 76 includes multiple records 78 corresponding to multiple patients. Each record 78 includes information such as patient ID, patient name, gender, and last examination date. The image list 80 includes multiple records 82 corresponding to multiple ultrasound examinations performed on the same patient. Each record 82 includes a header (information such as the examination date) 84 and an image list 86. In this embodiment, the search for past fetal images corresponding to the current fetal image is performed automatically. That is, the user does not need to select a secondary output target from each record 82. The past fetal image identified as a secondary output target (a representative past fetal image) is, for example, the last three-dimensional image acquired in a past ultrasound examination. Past fetal images may be identified based on other criteria. For example, the fetal image with the best quality may be identified as a past fetal image.

[0046] Figure 7 shows an example of the operation of the ultrasound diagnostic apparatus according to the embodiment. Specifically, this example of operation mainly shows the operation of the information processing unit (particularly the image processing unit).

[0047] If it is determined that an image collection needs to be output at the end of the current ultrasound examination, the operation shown in Figure 7 will begin. In S10, the ultrasound image to be output (the current fetal image) is selected based on the user's specification as the examiner. The current fetal image may be selected automatically. Specifically, the current fetal image is a three-dimensional image of the fetus that underwent the ultrasound examination.

[0048] In S12, the image database is searched to determine whether there are one or more past fetal images corresponding to the current fetal image. If the existence of any past fetal images is determined, the basic layout is added to the list of layout candidates. At this time, the number of past fetal images is checked. Based on that number, the allocation pattern in the basic layout is determined. For example, as mentioned above, for each past ultrasound examination, the last acquired three-dimensional image is identified as a past fetal image.

[0049] In S12, the image database is searched to determine whether there are one or more related images associated with the current fetal image. If related images are found, an optional layout for including those related images in the image collection is added to the layout candidate list. In practice, multiple optional layouts are available to accommodate multiple types of related images. This will be explained in detail later.

[0050] In S14, a list of layout candidates is displayed on the screen. Each layout candidate in the list is either a schematic diagram or an image collection itself. If each layout candidate is an image collection itself, the creation of the image collection (described later in S18) will be performed in S12.

[0051] In S16, the user selects one of the layout options from a list of layout candidates. The list of layout candidates also includes a layout that outputs only the current fetal image. Of course, multiple layouts may be selected based on the pregnant woman's preference or at the user's discretion.

[0052] In S18, an image collection is created according to the selected layout. For example, if the basic layout is selected, an image collection is created that includes the current fetal image and one or more past fetal images. If an optional layout is selected, an image collection is created that includes the current fetal image and related images. If multiple layouts are selected, multiple image collections corresponding to them are created. Each image collection is image data. An image collection basically corresponds to one page, but an image collection consisting of multiple pages may be created.

[0053] In S20, it is determined whether the image collection needs to be modified. If the user wishes to modify it, user operations on the image collection are accepted in S24. In S24, for example, the arrangement of images may be rearranged, the size of images may be changed, etc. In S26, the image collection is output. For example, the image collection is printed and the printed copy is given to the pregnant woman. Alternatively, the image collection is recorded on a storage medium and that storage medium is given to the pregnant woman. Alternatively, the image collection is delivered to the pregnant woman's terminal via the network.

[0054] Figure 8 shows the specific details of S12 shown in Figure 7. S12A shows the process of searching the image database. S12B shows the process of adding a layout to the layout candidate list and collecting images.

[0055] In step 62, the image database is searched to determine whether there are one or more past fetal images corresponding to the current fetal image. More specifically, if the fetus examined in the current ultrasound examination has undergone one or more ultrasound examinations in the past, one or more past fetal images obtained in those past ultrasound examinations are identified. In this embodiment, one past fetal image is identified for each past ultrasound examination. In step 62, the number m of past fetal images is determined. m is an integer of 1 or more.

[0056] Next, in step 62a, a basic layout with an allocation pattern to which n fetal images are allocated is added to the layout candidate list. n represents the number of allocated images, and n = m + 1. Here, +1 corresponds to the current fetal image. Meanwhile, in step 62b, assuming that the current fetal image has already been acquired, m past fetal images are acquired from the image database.

[0057] In step 63, the image database is searched to determine whether there are fetal images (other fetal images) of other fetuses related to the fetus being examined. Other fetal images are a type of related image. If the existence of other fetal images is determined, a multiple fetal layout is added to the layout candidate list in step 63a. The multiple fetal layout is a type of optional layout. In step 63b, assuming that the current fetal image has already been acquired, other fetal images are acquired from the image database. k fetal images are collected for k fetuses related to multiple fetuses. The allocation pattern of the multiple fetal layout is changed based on k. k is an integer greater than or equal to 2.

[0058] In step 64, the existence of a reference image is checked by searching the image database. The reference image is an image generated by processing the current fetal image, for example, by graphic overlay. The reference image is a type of related image. If the existence of a reference image is determined, in step 64a, a layout for inserting the reference image is added to the layout candidate list. This layout is a type of optional layout. In step 64b, assuming that the current fetal image has already been acquired, the reference image is acquired from the image database.

[0059] In step 66, the presence or absence of external images is checked by searching the image database. External images are images brought in by the pregnant woman. External images are a type of related image. If the presence of external images is determined, in step 66a, an external image insertion layout is added to the layout candidate list. This layout is a type of optional layout. In step 66b, assuming that the current fetal image has already been acquired, the external image is acquired from the image database.

[0060] In step 68, the presence or absence of an informational image is checked by examining the image database. An informational image is an image that includes the results of measurements based on the current fetal image. For example, an informational image is an image that includes measurements, graphs, or test reports. The presence or absence of content such as previous measurements, graphs, or test reports included in the informational image may also be checked. Such a check can also be considered a check for the presence or absence of an informational image. An informational image is a type of related image. If the presence or absence of an informational image is determined, in step 68a, an informational image insertion layout is added to the layout candidate list. This layout is a type of optional layout. In step 68b, assuming that the current fetal image has already been acquired, an external image is acquired from the image database. Images other than those described above may also be considered related images.

[0061] Figure 9 shows several basic layouts. Basic layout 88 has a pattern for assigning two fetal images. 3D-1 shows the current fetal image, and 3D-2 shows a past fetal image. Basic layout 90 has a pattern for assigning three fetal images. 3D-1 shows the current fetal image, and 3D-2 and 3D-3 show past fetal images, respectively. The higher the subscript number, the older the image.

[0062] Basic layout 92 has a pattern for assigning four fetal images. Basic layout 94 has a pattern for assigning five fetal images. In this embodiment, the maximum value of n is 5. For example, if six fetal images are identified as past fetal images, the oldest fetal image is not assigned. Of course, all fetal images may be assigned. In that case, a large number of images may be assigned across multiple pages. Each fetal image assigned to the basic layout is a three-dimensional image.

[0063] Figure 10 shows several optional layouts. These include a layout for multiple births 96, a layout for inserting a reference image 98, a layout for inserting an external image 100, and a layout for inserting an information image 102. The illustrated layout for multiple births 96 is specifically a layout for twin births, where a fetal image 104 of one fetus and a fetal image 106 of the other fetus are assigned. Both are three-dimensional images.

[0064] Layout 98 for inserting reference images is a layout for assigning reference image 108 and the current fetal image 110. Layout 100 for inserting external images is a layout for assigning external image 112 and the current fetal image 114. Layout 102 for inserting information images is a layout for assigning information image 116 and the current fetal image 118.

[0065] Next, we will explain a specific example of an image collection using Figures 11 to 16. Figure 11 shows image collection 120. Image collection 120 is created according to a basic layout for n=3 and includes the current fetal image 122 and two past fetal images 124 and 126. Each fetal image 122, 124, and 126 includes gestational age information. By observing this gestational age information, the temporal relationship between fetal images 122, 124, and 126 can be correctly understood.

[0066] Figure 12 shows image collection 130. Image collection 130 is created according to a layout for multiple births and includes fetal images 132 of fetus A and fetal images 134 of fetus B. Both fetal images 132 and 134 are images obtained using current ultrasound examinations.

[0067] Figure 13 shows image collection 136. Image collection 136 is created according to a layout for inserting reference images and includes reference image 138 and the current fetal image 140. Reference image 138 is an image generated by processing the current fetal image 140, and in the illustrated example, graphics including icons and text have been added to the current fetal image 140.

[0068] Figure 14 shows image collection 142. Image collection 142 is created according to an external image insertion layout and includes external image 146 and current fetal image 144. External image 146 is an image brought in by the pregnant woman, such as a family photograph. Of course, other external images may be inserted.

[0069] Figure 15 shows image collection 148. Image collection 148 is created according to the layout for inserting informational images and includes informational image 152 and the current fetal image 150. Informational image 152 includes a graph composed of multiple measurements arranged in chronological order. The horizontal axis of the graph is the time axis, and its vertical axis is the axis indicating the magnitude of the measurements.

[0070] Figure 16 shows image collection 154. Image collection 154 is created according to the layout for inserting informational images and includes informational image 158 and current fetal image 156. Informational image 158 is an examination report image. It includes measured values, graphs showing changes in measured values, findings, etc.

[0071] Figure 17 shows an example of a layout candidate list. The illustrated layout candidate list 160 includes multiple layout candidates (A) to (F). Layout candidate (A) is selected when outputting only the current fetal image. Layout candidate (B) is the basic layout, and layout candidates (C) to (F) are optional layouts, specifically a layout for multiple births, a layout for inserting reference images, a layout for inserting external images, and a layout for inserting informational images.

[0072] According to the above embodiment, by referring to the layout candidate list, users can easily identify one or more image sets that can be output and select the image set to be output from among them. Since the search for outputtable image sets is performed automatically, there is no burden on the user during the search. Furthermore, since a variety of layouts can be included in the layout candidate list, it is possible to meet the diverse needs of pregnant women. [Explanation of Symbols]

[0073] 16 Tomographic image forming unit, 18 Three-dimensional image forming unit, 20 Information processing unit, 22 Storage unit, 42 Data management unit, 44 Image processing unit.

Claims

1. Includes an image processing unit, The aforementioned image processing unit, A selection method for selecting the current fetal image obtained from the current ultrasound examination of the fetus as the primary output target, A first determination means that investigates an image database and determines whether or not past fetal images obtained from past ultrasound examinations of the fetus exist, If the existence of the aforementioned past fetal images is determined, a first additional means adds a basic layout for assigning the current fetal image and the aforementioned past fetal images to a layout candidate list. A second determination means that investigates the aforementioned image database and determines whether there are any related images other than the aforementioned past fetal images that are related to the aforementioned current fetal image, If the existence of the aforementioned related image is determined, a second additional means adds an optional layout for assigning the current fetal image and the aforementioned related image to the layout candidate list, An output means that outputs an image collection that includes the current fetal image, which follows a layout selected by the user from the aforementioned list of layout candidates, An ultrasonic image processing apparatus characterized by including

2. In the ultrasonic image processing apparatus according to claim 1, The first determination means determines the number of past fetal images obtained from multiple past ultrasound examinations of the fetus if the image database contains multiple past fetal images. The image processing unit includes a determination means for determining the allocation pattern in the basic layout based on the number of items. An ultrasonic image processing apparatus characterized by the following:

3. In the ultrasonic image processing apparatus according to claim 1, When the basic layout is selected from the list of layout candidates, a means is provided for adding gestational age information to each fetal image assigned according to the basic layout. An ultrasonic image processing apparatus characterized by the following:

4. In the ultrasonic image processing apparatus according to claim 1, The current fetal image and the past fetal image, which are allocated according to the basic layout, are three-dimensional images generated based on volume data acquired from within the mother's body. An ultrasonic image processing apparatus characterized by the following:

5. In the ultrasonic image processing apparatus according to claim 1, The aforementioned related images include fetal images of other fetuses that are related to the aforementioned fetus in a multiple birth relationship. The aforementioned optional layouts include a layout for multiple births. An ultrasonic image processing apparatus characterized by the following:

6. In the ultrasonic image processing apparatus according to claim 1, The aforementioned related images include a reference image generated by processing the current fetal image. The optional layout includes a layout for assigning the current fetal image and the reference image, An ultrasonic image processing apparatus characterized by the following:

7. In the ultrasonic image processing apparatus according to claim 1, The aforementioned related images include external images provided by pregnant women. The aforementioned optional layout includes a layout for assigning the current fetal image and the external image. An ultrasonic image processing apparatus characterized by the following:

8. In the ultrasonic image processing method according to claim 1, The aforementioned related images include informational images containing the results of measurements taken on the fetus. The aforementioned optional layout includes a layout for assigning the current fetal image and the information image, An ultrasonic image processing apparatus characterized by the following:

9. Includes an image processing step, The aforementioned image processing step is: The process involves selecting the current fetal image obtained from the current ultrasound examination of the fetus as the primary output target, A step of investigating an image database and determining whether or not past fetal images obtained from past ultrasound examinations of the fetus exist, If the existence of the aforementioned past fetal images is determined, the step of adding a basic layout for assigning the current fetal image and the aforementioned past fetal images to a list of layout candidates, The steps include: investigating the image database and determining whether there are any related images other than past fetal images that are related to the current fetal image, If the existence of the aforementioned related image is determined, the step of adding an optional layout for assigning the current fetal image and the aforementioned related image to the layout candidate list, A step of outputting an image collection that includes the current fetal image, which follows a layout selected by the user from the aforementioned list of layout candidates, An ultrasonic image processing method characterized by including

10. A program having an image processing function for performing an ultrasonic image processing method in an information processing device, The aforementioned image processing function is A function to select the current fetal image obtained from the current ultrasound examination of the fetus as the primary output target, The function involves searching an image database to determine whether or not past fetal images obtained from previous ultrasound examinations of the fetus exist. When the existence of the aforementioned past fetal images is determined, a function is provided to add a basic layout for assigning the current fetal image and the aforementioned past fetal images to the layout candidate list. The function involves searching the aforementioned image database and determining whether there are any related images other than the past fetal images that are associated with the current fetal image, If the existence of the aforementioned related image is determined, a function is provided to add an optional layout for assigning the current fetal image and the aforementioned related image to the layout candidate list. A function to output an image collection that includes the current fetal image, which follows the layout selected by the user from the aforementioned list of layout candidates, A program characterized by including the following:

Images