JP2006130071A - Image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus capable of obtaining a composite three-dimensional image having a good image quality in an image processing apparatus capable of displaying a three-dimensional image while achieving both grasping of a structure of an inspection object and extraction of a surface shape.
In a three-dimensional image generation unit 106, a volume rendering mode region setting unit 201 and a volume rendering mode calculation unit 203 are used for generating a three-dimensional image in a volume rendering mode, and an X-ray photograph mode region setting unit. 202 and the X-ray photography mode calculation unit 204 are used to generate a three-dimensional image in the X-ray photography mode. The buffer 205 and the buffer 206 store the calculation results of the volume rendering mode calculation unit 203 and the X-ray photograph mode calculation unit 204, respectively. The synthesized 3D image generation unit 207 synthesizes two types of 3D images, and the synthesis ratio adjustment unit 208 functions when the user changes the synthesis rate of the two types of 3D images.
[Selection] Figure 2

Description

  The present invention relates to an image processing apparatus for observing an inspection object three-dimensionally.

  Today, medical image diagnosis is capable of observing internal information of an inspection object in a non-destructive manner and is widely used as an indispensable diagnostic means. For example, X-ray CT (Computerized Tomography), MRI (Magnetic Resonance Imaging), an ultrasonic diagnostic apparatus, etc. can acquire a tomographic image of a subject in a non-invasive manner. In recent years, a technique for forming a three-dimensional image from a plurality of tomographic images acquired by these apparatuses has been actively developed, and a volume rendering method, a projection method, and the like are often used.

  For example, Patent Document 1 proposes a three-dimensional image processing method based on a volume rendering method. By using such 3D display technology, doctors and laboratory technicians can visually confirm the structure of the test object, enabling more accurate diagnosis and providing informed consent to the patient. It can be used effectively.

  In order to improve the image quality of the obtained three-dimensional image, a method of automatically setting the starting point of volume rendering processing as shown in Patent Document 2 has been proposed. According to this method, it is possible to automatically remove the shielding object located in front of the inspection object from the target area of the volume rendering process with respect to the line-of-sight direction in which the volume rendering process is performed. Improvement of image quality and reduction of work time for processing area setting can be realized at the same time.

  According to the volume rendering method described above, the surface shape of the subject can be extracted and displayed three-dimensionally (hereinafter referred to as volume rendering mode). For example, pixel values are integrated in the line-of-sight direction. By performing processing based on the projection method, it is possible to generate a three-dimensional image as if it were an X-ray photograph (hereinafter referred to as an X-ray photograph mode). Although it is difficult to describe the surface shape of the inspection object in detail in this method due to the nature of the process, it is possible to obtain a single image containing all the structural information about the inspection object. It can be said that this is a three-dimensional image processing method suitable for grasping the entire structure of the inspection object region.

In addition, 3D image generation in both volume rendering mode and X-ray photography mode is generated for the same inspection area, and finally one synthesized image is generated and displayed, so that the overall structure can be understood and inspected. It has also become possible to create a composite three-dimensional image that can acquire both detailed surface shapes of an object.
JP-A-10-33538 JP 2001-145631 A

  However, when creating a composite 3D image from a 3D image in the volume rendering mode and the X-ray photography mode in the conventional configuration, if the priority is given to grasping the structure of the inspection object (for example, fetus), the shielding object is not removed. In addition, the influence of a shield (for example, placenta), which is unnecessary information, appears strongly in the volume rendering mode three-dimensional image created to extract the surface shape of the subject.

  On the other hand, if priority is given to obtaining the surface shape of the subject, the removal of the shielding object is performed. Therefore, the three-dimensional image of the X-ray photograph mode created for grasping the structure includes the entire structure of the inspection object (for example, the fetus). And placenta) will be missing.

  Generating a synthesized 3D image using such an image includes unnecessary information such as a placenta in one of the 3D images to be synthesized or necessary information such as the overall structure. It is obvious that the image quality of the resultant synthesized three-dimensional image is degraded due to the lack of. As described above, in the generation of a synthesized 3D image in a conventional ultrasonic diagnostic apparatus or the like, it is difficult to achieve both the extraction of the surface shape of the inspection object and the grasp of the structure from one synthesized 3D image.

These problems will be described using specific images with reference to the drawings.
FIG. 17 shows an example of the functional configuration of a three-dimensional image composition unit 306 provided in a conventional ultrasonic diagnostic apparatus that performs composite three-dimensional image generation. The 3D image generation unit 306 receives data to be subjected to 3D processing from the image generation unit, and the 3D processing region setting unit 309 sets a region for performing 3D processing. The three-dimensional processing region setting unit 309 may use the automatic three-dimensional processing region setting method disclosed in Patent Document 2 described above, or the user manually sets a processing region from a console not shown. May be. The volume rendering mode calculation unit 303 and the X-ray photograph mode calculation unit 304 generate a three-dimensional image using the respective methods for the region set by the three-dimensional processing region setting unit 309. The synthesized 3D image generation unit 307 synthesizes the 3D images generated by the calculation units 303 and 304 to generate a synthesized 3D image.

  FIG. 9 shows an example of an image obtained when measurement is performed using an ultrasonic diagnostic apparatus. The imaging region 109 is a cross section of a three-dimensional region imaged by scanning the inspection target region using ultrasonic waves. The object 107 and the shield 108 are assumed to be a fetus and a placenta, respectively, and the arrows shown in the figure are the search axis direction or the projection axis direction in the three-dimensional processing. It shows that dimension processing is performed. An arrow is not shown on the screen of a normal ultrasonic diagnostic apparatus.

  When generating a three-dimensional image, a tomographic image as shown in FIG. 9 is acquired for the entire region to be processed in three-dimensional processing, and three-dimensional data called volume data is acquired. When three-dimensional processing is performed on the volume data in the direction of the arrow, it is possible to obtain a three-dimensional image as if the processing target region was observed from the direction of the arrow.

  FIG. 10 is a diagram showing a state in which a user manually sets a three-dimensional processing region by the method disclosed in Patent Document 2 or from a console (not shown). In this figure, a three-dimensional processing start line 110 is set so as to surround the fetus which is the subject 107. In the method of automatically setting a three-dimensional processing region according to Patent Document 2, the three-dimensional processing region is automatically set based on the difference in luminance value between the structure and the amniotic fluid.

  FIGS. 11 and 13 show images 1100 and 1300 when a three-dimensional image is generated in the volume rendering mode and the X-ray photography mode without performing obstruction removal (here, placenta removal), respectively. An image as shown in FIG. 11 is obtained in the volume rendering mode and as shown in FIG. 13 in the X-ray photography mode. In FIG. 11, when performing volume rendering, the placenta covers the fetus that is the original observation target, and thus the shape of the fetus cannot be observed by the placenta. On the other hand, in the X-ray photography mode shown in FIG. 13, generally, all the pixel values located on the projection axis are integrated and three-dimensional processing is performed, so that a good three-dimensional that reflects all the structure information of the inspection target region. An image 1300 is obtained.

  Next, FIGS. 12 and 14 show images 1200 and 1400 as a result of performing the three-dimensional processing only on the data included in the region by setting the three-dimensional processing region by either a manual or automatic method. FIG. 12 shows an image obtained in the volume rendering mode. Since the placenta, which is a shielding object, is removed by removing the shielding object, an image 1200 that is favorable for observing the shape of the fetus can be obtained. On the other hand, FIG. 14 shows a three-dimensional image 1400 obtained in the X-ray photography mode, but information on the placenta located so as to cover the fetus is removed by the three-dimensional processing region setting. An image 1400 with a small amount of information is obtained in order to acquire and grasp the structure information of the region to be inspected.

  Next, a specific example of a synthesized three-dimensional image obtained using an image processing apparatus having a conventional configuration as shown in FIG.

  FIG. 15 is a composite three-dimensional image 1500 of a volume rendering mode image (corresponding to the image 1100 shown in FIG. 11) and an X-ray photograph mode image (corresponding to the image 1300 shown in FIG. 13) when the obstruction removal is not performed. 3D combined volume rendering mode image (corresponding to the image 1200 shown in FIG. 12) and X-ray photograph mode image (corresponding to the image 1400 shown in FIG. 14) in the case of performing the 3D region processing and also removing the obstruction. Each image 1600 is shown.

  In the case of the conventional ultrasonic diagnostic apparatus as shown in FIG. 17, even when a plurality of types of three-dimensional images are generated by different three-dimensional processing methods, only one three-dimensional processing region is set. Information that also requires an image, for example, local shape information in the case of FIG. 15 and overall structure information in the case of FIG. 16 are missing, and a composite three-dimensional image is acquired with sufficient image quality and information amount. It has the problem that it is difficult.

  Therefore, since it is difficult to obtain all necessary information from such a composite image, a user such as a doctor or a laboratory technician rotates the acquired three-dimensional image and observes it from a different direction, or three-dimensional image In other words, it is necessary to understand the positional relationship between the subject position and the entire inspection target area by simultaneously displaying a multi-sectional image, and there is a problem that it takes time and effort for the user.

  The present invention solves the above-described conventional problems, and can perform both grasping the structure of an inspection object and improving image quality when displaying a three-dimensional image using a synthesized three-dimensional image. And an image processing method.

  In order to solve the above-described conventional problems, the image processing apparatus of the present invention acquires volume data, which is information of a three-dimensional space including an inspection object, and performs three-dimensional processing on the volume data. An image processing apparatus for generating a three-dimensional image, wherein a plurality of three-dimensional processing area setting means are provided for setting a plurality of three-dimensional processing areas to be subjected to three-dimensional processing on data selected from the volume data. A plurality of three-dimensional image generation means for generating a plurality of three-dimensional images by performing three-dimensional processing on each of the plurality of three-dimensional processing regions, and combining the plurality of three-dimensional images to obtain a combined three-dimensional image. And a synthesized three-dimensional image generating means for generating.

  Further, the plurality of three-dimensional processing areas set by the plurality of three-dimensional processing area setting means of the image processing apparatus according to the present invention are set independently of each other.

  With these configurations, the three-dimensional processing region setting unit can set a plurality of three-dimensional processing regions, and the three-dimensional image generated by the three-dimensional image generation unit has the same three-dimensional processing method. However, it is possible to set a region or a range for performing the three-dimensional processing as a region different from each other for each observation purpose, and to avoid missing image information requested by the user.

  The image processing apparatus according to the present invention further includes a composition ratio changing unit that changes a composition ratio of the plurality of three-dimensional images, and the composition three-dimensional image generating unit is changed by the composition ratio changing unit. The composite three-dimensional image is generated based on the composite ratio.

  With this configuration, it is possible to easily change the composition ratio of the plurality of three-dimensional image generation methods in the composition ratio changing unit and provide an image desired by the user.

  Further, in the plurality of three-dimensional image generation means of the image processing apparatus according to the present invention, the plurality of three-dimensional image generation means includes first and second three-dimensional image generation means, and the first three-dimensional image generation means The three-dimensional image generation means generates a first three-dimensional image based on a three-dimensional image processing method based on a volume rendering method, and the second three-dimensional image generation means uses a three-dimensional image processing based on a projection method. A second three-dimensional image is generated based on the method. The first three-dimensional image generation unit and the second three-dimensional image generation unit both generate the first and second three-dimensional images using a three-dimensional image processing method based on the volume rendering method. It is characterized by that.

  With these configurations, as a three-dimensional image processing method, it is possible to generate a combined three-dimensional image in the three-dimensional image generation unit by combining a volume rendering method and a projection method in which different three-dimensional processing regions are set.

  The image generation apparatus according to the present invention further changes the weighting of pixels when performing the three-dimensional processing based on the plurality of three-dimensional processing regions set by the plurality of three-dimensional processing region setting means. A plurality of pixel value weighting means are provided, and the synthesized three-dimensional image generating means synthesizes the synthesized three-dimensional image based on the weighting changed in the plurality of pixel value weighting means.

  With this configuration, since the weighting of a plurality of three-dimensional images can be changed in the pixel value weighting means, an image suitable for the user's request such as the surface shape of the inspection object and the entire structure of the inspection object area is provided. Is possible.

  In order to achieve the above object, the present invention can be realized as an image processing method having characteristic means of the image processing apparatus as steps, or as a program for causing a computer to execute each step. . It goes without saying that such a program can be distributed through a recording medium such as a CD-ROM or a transmission medium such as the Internet.

  According to the image processing device of the present invention, it is possible to provide an image processing device that achieves both the grasp of the structure of the inspection object and the improvement of the image quality, particularly in the case of performing a 3D image display using a synthesized 3D image. Become.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiment, an ultrasonic diagnostic apparatus will be described as an example of an image processing apparatus, but the effects of the present invention are not limited to the ultrasonic diagnostic apparatus.
(Embodiment 1)
FIG. 1 is a block diagram of an ultrasonic diagnostic apparatus 10 having a three-dimensional image display function according to Embodiment 1 of the present invention.

  In FIG. 1, a probe 100 transmits and receives ultrasonic waves to and from an inspection target to collect information about the inspection target region, a transmission / reception control unit 101 controls the probe 100, and a signal processing unit 102 receives the probe 100. The image generation unit 103 performs rearrangement and coordinate conversion of the ultrasonic data processed in the signal processing unit 102, and performs three-dimensional image generation unit. Reference numeral 106 performs a three-dimensional process on the three-dimensional data generated by the image generation unit 103 to generate a three-dimensional image, and displays the result of the luminance conversion performed by the image generation unit 103 on the image display unit 104. The cine memory 105 stores the obtained ultrasonic data, and is used to read out the data again and reuse it as necessary.

  In the three-dimensional image generation unit 106, an area for performing three-dimensional processing is set by manual input by a user operating a console (not shown) or by an automatic setting method disclosed in Patent Document 2 or the like, and the set range Arbitrary three-dimensional processing including volume rendering is performed.

  FIG. 2 shows a functional configuration diagram of the characteristic three-dimensional image generation unit 106 of the present invention for generating a good synthesized three-dimensional image. In the first embodiment, a case will be described in which a synthesized three-dimensional image is generated from two types of three-dimensional images, ie, a volume rendering mode and an X-ray photography mode.

  The volume rendering mode region setting unit 201 and the volume rendering mode calculation unit 203 are used to generate a three-dimensional image in the volume rendering mode, and the X-ray photograph mode region setting unit 202 and the X-ray photograph mode calculation unit 204 are X-rays. Used to generate 3D images in photographic mode. The buffer 205 and the buffer 206 store the calculation results of the volume rendering mode calculation unit 203 and the X-ray photograph mode calculation unit 204, respectively.

  FIG. 3 is a flowchart showing an operation procedure of the three-dimensional image generation unit 106 of the ultrasonic diagnostic apparatus according to the first embodiment.

  Each volume rendering mode area setting unit 201 and X-ray photograph mode area setting unit 202 receives the same data (targeted for three-dimensional processing) and generates a three-dimensional image based on the volume rendering method (S301) and the X-ray photograph mode method. A three-dimensional image is generated based on (S302). Note that the processing in S301 and S302 may be performed in parallel, or the processing in S302 may be performed before the processing in S301.

  4A and 4B show detailed operation procedures of S301 in the volume rendering mode area setting unit 201 and S302 in the X-ray photography mode area setting unit 202 provided in the three-dimensional image generation unit 106. FIG. It is a flowchart.

  First, the volume rendering mode area setting unit 201 and the X-ray photography mode area setting unit 202 set the same data processing area to be subjected to three-dimensional processing (S401 and S406), but in the volume rendering mode as described above. Since the object is to acquire the shape information of the object, it is necessary to remove the shielding object in front of the object with respect to the viewing direction in order to obtain a good three-dimensional image. For this reason, the volume rendering mode area setting unit 201 performs shielding removal together with the processing area setting shown in S401. The removal of the shielding object may be manually set by a user from a console (not shown), or an automatic area setting method disclosed in Patent Document 2 may be used.

  Next, as shown in the loop processing (S402 to S405) after setting the three-dimensional processing area in the figure, the entire volume in the three-dimensional processing area is based on the volume rendering area set in the volume rendering mode area setting unit 201. The volume rendering mode calculation unit 203 performs volume rendering calculation for all the regions (S403), and the result is stored in the buffer 205 (S404). If it is necessary to repeat the setting of the three-dimensional processing area shown in S401, it can be included in the loop (S402 to S405).

  On the other hand, in the case of the X-ray photography mode, since the purpose is to observe the structural information of the entire inspection target area, it is not necessary to remove the shielding object. In S406, the X-ray photography mode area setting unit 202 performs the X-ray photography. After the mode area is set, the start point of the X-ray photograph mode calculation process is set in front of the line-of-sight direction of the three-dimensional processing target data. The X-ray photograph mode calculation unit 204 calculates the X-ray photograph mode based on the X-ray photograph mode area set by the X-ray photograph mode area setting unit 202 (if it is not set, from the data at the forefront of the line-of-sight direction). (S408), the result is output to the buffer 206 and stored (S409).

  The same processing is performed on all the volume data in the inspection target area (loop: S402 to S405 and S407 to 410), so that the three-dimensional image in the volume rendering mode is stored in the buffer 205 and the 3 in the X-ray photography mode. The dimensional image is stored in the buffer 206 (S404 and S409). At this time, the three-dimensional images stored in the buffer 205 and the buffer 206 are set with appropriate regions for the respective types of three-dimensional images, so that the three-dimensional images alone have good image quality. become.

  Next, the two types of three-dimensional images acquired in this way are combined by the combined three-dimensional image generation unit 207, and a final combined three-dimensional image is generated (S303). The composition method in the composition three-dimensional image generation unit 207 may use so-called alpha blending, or a method of selecting both pixels so that the ratio of the number of pixels included in the local region follows the composition ratio. It may be used, or a different color may be assigned to each of the three-dimensional images to be synthesized, and the result of synthesis may be confirmed by the color mixture. In the present invention, any method can be used as long as the influence of the two kinds of original images can be confirmed in the finally obtained composite three-dimensional image.

  The composition ratio adjustment unit 208 functions when the user changes the composition ratio of the two types of three-dimensional images using a dial or a slider provided on a console (not shown) (S304). For example, when the composition method is alpha blending, the composition ratio of the volume rendering mode to the X-ray photograph mode can be changed to an arbitrary ratio. If it is desired to pay attention to the shape of the subject, the ratio is set to 0.9: 0.1. If the observation of the structure information of the inspection target area is the main purpose, the ratio is set to 0.2: 0.8. be able to. Note that the composition ratio in the composition ratio adjusting unit 208 can be arbitrarily set within a range of, for example, 1.0: 0.0 to 0.0: 1.0.

  Thus, the user can adjust the composition ratio to the composite three-dimensional image so that the information about the surface shape and the information about the entire structure can be appropriately displayed using the composition ratio adjustment unit 208. Since the synthesized three-dimensional image obtained by the ultrasonic diagnostic apparatus 10 according to the present invention is synthesized from a three-dimensional image in a volume rendering mode and an X-ray photograph mode with good image quality, the composition ratio can be easily set by the user by operating a button. The image information desired by the user can be provided with good image quality.

  Then, the three-dimensional image or the synthesized three-dimensional image obtained by the three-dimensional image generation unit 106 is sent again to the image generation unit 103, stored in a frame memory (not shown), and then displayed on a monitor or the like by the image display unit 104. Is done.

  FIG. 5 is a reference diagram of the synthesized three-dimensional image 500 generated by the ultrasonic diagnostic apparatus according to the first embodiment. As shown in the figure, in the first embodiment, the above-described image 1200 shown in FIG. 12 and the image 1300 shown in FIG. 13 can be combined to form a three-dimensional image 500. In comparison, it is possible to obtain an image in which information on the surface shape and information on the entire structure are appropriately displayed.

  As described above, the ultrasound diagnostic apparatus 10 according to the first embodiment includes the volume rendering mode region setting unit 201 and the X-ray photograph mode region setting unit 202, and in each of the three-dimensional image processing methods, Since each processing area is set, the advantages of both image processing methods, that is, the volume rendering method can be obtained even when a composite three-dimensional image is acquired by combining a volume rendering method and a projection method such as an X-ray photography mode. Display of the surface shape of the detection object in the X-ray display mode, and a clear composite three-dimensional image that retains the display of the overall structure and the sense of depth in the X-ray display mode, thereby making it easier for the user to identify the inspection object Can do.

  Further, since the composition ratio adjustment unit 208 can adjust the ratio of the volume rendering mode and the X-ray photography mode, for example, only the surface shape information is acquired, and the image display device adapted to the form in use by the user It becomes possible.

  In the first embodiment, the case of synthesizing two types of three-dimensional images of volume rendering mode and X-ray photography mode has been described as an example. However, a combination of different types of three-dimensional images may be used. In addition, here, two types of three-dimensional images to be combined are used, but the same method can be used when two or more types of three-dimensional images are combined. That is, the same effect can be obtained by individually having a calculation area setting unit for improving the image quality of each of the three-dimensional images to be combined.

  In the first embodiment, a method for generating a synthesized 3D image at a predetermined synthesis rate after the respective 3D images are completed in the buffer 205 and the buffer 206 has been described. A configuration may be adopted in which the obtained three-dimensional data is sequentially synthesized.

In the first embodiment, the three-dimensional image to be synthesized is a three-dimensional image generated by a technique based on the volume rendering method and the projection method. However, in the present invention, regardless of a specific three-dimensional processing method, It goes without saying that a 3D image to be synthesized may be generated by any method as long as it is a processing method capable of displaying in 3D.
(Embodiment 2)
Next, a second embodiment of the image processing apparatus according to the present invention will be described with reference to the drawings. The ultrasonic diagnostic apparatus according to the second embodiment is characterized in that, when a synthesized three-dimensional image is synthesized, two three-dimensional processing regions are set and the obtained two three-dimensional images are weighted. .

  FIG. 6 is a block diagram of the 3D image generation unit 606 in the ultrasonic diagnostic apparatus having the 3D image display function according to Embodiment 2 of the present invention. In the description of the second embodiment, the same reference numerals are used for the above-described components, and the description thereof is omitted.

  In FIG. 6, two two-dimensional images to be synthesized are both generated by volume rendering, and volume rendering is performed based on the setting of the three-dimensional processing region when generating each three-dimensional image and the region. An example will be shown in which the weight of the contributing pixel value is changed so that the overall structure and the subject shape can both be displayed well when the synthesized three-dimensional image is old.

  FIG. 8 is a flowchart showing a processing procedure of the three-dimensional image generation unit 606 of the ultrasonic diagnostic apparatus according to the second embodiment.

  As in the first embodiment, the first and second three-dimensional processing region setting units 212 and 213 may use a three-dimensional processing region automatic setting method, or may be manually set by the user (S801). ). The first weighting unit 210 and the second weighting unit 211 perform pixel value weighting according to a predetermined method based on the three-dimensional processing regions set in the first and second three-dimensional region setting units 212 and 213, respectively. (S802) The volume rendering mode calculation unit 203 generates a three-dimensional image (S803), and sends the result to the combined three-dimensional image generation unit 207 to generate a combined image (S804).

  In FIG. 6 described above, two volume rendering mode calculation units 203 are shown. This is to clearly indicate that image data with different processing areas and pixel weights is to be processed. Needless to say, if the processing is performed and the processing speed is appropriate, the number of arithmetic units may be one.

  FIG. 7 is a reference diagram illustrating an example in which different three-dimensional processing regions are set in the ultrasound image by the first and second three-dimensional processing region setting units 212 and 213.

  The first and second processing area setting lines 214 and 215 indicate the result of performing area setting for performing extraction of objects other than the object and extraction of the object, respectively. Since the second region setting line 215 is a region setting for extracting the shape of the object (fetus), the weighting coefficient is set to 1.0 inside the region, and the outside of the region is abruptly as a function of the distance from the line. Set to have a coefficient that decreases in value.

  The first area setting line 214 reflects the structure of the portion excluding the object, so that the pixel values inside the area do not contribute to the volume rendering operation, and the object (fetus) is also outside the area. Weighting is performed so that the pixel value used in the volume rendering operation is small so that the cover (placenta) covering the surface does not become too bright due to the volume rendering mode operation and only the surface is not extracted. Do.

  As described above, in the ultrasonic diagnostic apparatus according to the second embodiment, the first three-dimensional image generated by the first volume rendering mode computing unit 203 is generated in the volume rendering mode. First, it is possible to acquire a volume rendering mode three-dimensional image influenced by the entire inspection target area excluding the object. In addition, the second three-dimensional image generated by the second volume rendering mode calculation unit 203 extracts the surface of the object because the influence of the shielding object is much smaller than that of the object. Volume rendering mode A three-dimensional image can be acquired.

  Therefore, in the synthesized three-dimensional image generation unit 207 according to the second embodiment, the first and second volume rendering mode three-dimensional images are synthesized to form the surface shape of the object, the entire structure of the inspection target region, It is possible to acquire information such as the position of the object in the inspection target area with good image quality. Note that the region located inside the first region setting line 214 and outside the second region setting line 215 is amniotic fluid in the case of the second embodiment, and is originally a portion having a very low pixel value. It can be considered that false information hardly occurs at the boundary of the setting line.

  In the ultrasonic diagnostic apparatus according to the second embodiment, it is possible to acquire three-dimensional images having different properties while keeping various three-dimensional processing parameters (such as opacity) in the volume rendering mode calculation unit 203 common. By using this method as described here, it is possible to obtain a three-dimensional image having a different property even when a three-dimensional processing method of the same kind (and with the same parameters) is used instead of a different three-dimensional processing method. It is possible to obtain a plurality of pieces of information with improved image quality by combining them.

  Further, by adjusting the composition ratio by the composition ratio adjustment unit 208, for example, the object (fetus) is displayed more clearly, and a transparent feeling is given by the shielding object (placenta), so that the fetus is included in the placenta. It is also possible to acquire a synthesized three-dimensional image that can give an impression of being.

  In the second embodiment, a method for generating a three-dimensional image having different properties by changing the weighting of pixel values based on the respective region settings after performing different region settings has been described. Instead of changing the weighting, other parameters of the three-dimensional processing may be changed. Furthermore, although the first region setting line 214 and the second region setting line 215 described in the second embodiment have been described as being different from each other, an object (here, a fetus) and the other (a shield such as a placenta) When it can be divided by one area setting line, the same area setting line may be used.

  In the second embodiment, two 3D images to be combined are generated in the volume rendering mode. However, the present invention is not limited to the volume rendering mode. Further, the number of three-dimensional images to be combined is not limited to two.

  The image processing apparatus according to the present invention performs processing on digitized image data, and is used not only as an ultrasonic image used as an example but also as an X-ray CT, MRI, or other medical image diagnostic apparatus in general. It is possible. The effects obtained by this method are not limited to medical applications, but are useful for image processing in various fields such as industrial non-destructive inspection and special effects on commonly used digital photographic data.

Block diagram of 3D ultrasound system The figure which showed the structure of this invention in Embodiment 1 6 is a flowchart showing an operation procedure of a three-dimensional image generation unit of the ultrasonic diagnostic apparatus according to the first embodiment. (A) Flowchart showing detailed operation procedure of S301 in volume rendering mode region setting unit (b) Flowchart showing detailed operation procedure of S302 in X-ray photograph mode region setting unit The figure which showed an example of the synthetic | combination three-dimensional image obtained by this invention The figure which showed the structure of this invention in Embodiment 2 The figure which showed the result in Embodiment 2 which performed the different area | region setting according to the objective 7 is a flowchart showing a processing procedure of a three-dimensional image generation unit of the ultrasonic diagnostic apparatus according to the second embodiment. The figure which showed an example of the image obtained by the ultrasonic diagnostic apparatus The figure which set the processing field to the image obtained by the ultrasonic diagnostic equipment The figure which showed the example which produced | generated the three-dimensional image of the volume rendering mode, without performing an obstruction removal The figure which showed the example which performed the obstruction removal and produced | generated the three-dimensional image of the volume rendering mode Diagram showing an example of generating a 3D image in X-ray photography mode without removing the obstruction Diagram showing an example of generating a three-dimensional image in the X-ray photography mode after removing the obstruction The figure which showed the example of the synthetic | combination 3D image produced | generated by the synthesis | combination of the volume rendering mode and X-ray photography mode which were created without performing obstruction removal The figure which showed the example of the synthetic | combination 3D image produced | generated by the synthesis | combination of the volume rendering mode and X-ray photography mode which were created by performing the obstruction removal Functional configuration diagram of a conventional 3D image generation unit that generates a synthesized 3D image

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Ultrasonic diagnostic apparatus 100 Probe 101 Transmission / reception control part 102 Signal processing part 103 Image generation part 104 Image display part 105 Cine memory 106 3D image generation part 107 Subject 108 Shielding object 109 Imaging area 110 3D processing area start line 201 Volume rendering Mode region setting unit 202 X-ray photograph mode region setting unit 203 Volume rendering mode calculation unit 204 X-ray photograph mode calculation unit 205 Buffer 206 Buffer 207 Composite three-dimensional image generation unit 208 Composite ratio adjustment unit 209 Three-dimensional processing region setting unit 210 DESCRIPTION OF SYMBOLS 1 Weighting part 211 2nd weighting part 212 1st-3D processing area setting part 213 2nd-3D processing area setting part 214 1st area setting line 215 2nd area setting line 606 3D image generation part

Claims (11)

An image processing apparatus that acquires volume data that is information of a three-dimensional space including an inspection object, generates a three-dimensional image by performing three-dimensional processing on the volume data,
A plurality of three-dimensional processing region setting means for setting a plurality of three-dimensional processing regions to be subjected to three-dimensional processing on the data selected from the volume data;
A plurality of three-dimensional image generation means for generating a plurality of three-dimensional images by performing a three-dimensional process on each of the plurality of three-dimensional processing regions;
An image processing apparatus comprising: a combined 3D image generation unit configured to combine the plurality of 3D images to generate a combined 3D image. The image processing apparatus according to claim 1, wherein the plurality of three-dimensional processing areas set by the plurality of three-dimensional processing area setting units are set independently of each other. The image processing apparatus further includes:
Comprising a composition ratio changing means for changing a composition ratio of the plurality of three-dimensional images;
The image processing apparatus according to claim 1, wherein the synthesized three-dimensional image generation unit generates the synthesized three-dimensional image based on the synthesis ratio changed by the synthesis ratio change unit. The plurality of three-dimensional image generation means includes first and second three-dimensional image generation means,
The first three-dimensional image generating means generates a first three-dimensional image based on a three-dimensional image processing method based on a volume rendering method;
The image processing apparatus according to claim 1, wherein the second three-dimensional image generation unit generates a second three-dimensional image based on a three-dimensional image processing method based on a projection method. The first three-dimensional image generation means and the second three-dimensional image generation means both generate the first and second three-dimensional images using a three-dimensional image processing method based on a volume rendering method. The image processing apparatus according to claim 4, wherein: The image processing apparatus according to claim 3, wherein the combination ratio changing unit uses a combination ratio of pixel values of each of the plurality of three-dimensional images to be combined as the combination ratio. The image processing apparatus according to claim 3, wherein the combination ratio changing unit uses a ratio of the number of pixels of each of the plurality of three-dimensional images to be combined as the combination ratio. The image processing apparatus according to claim 3, wherein the synthesis ratio changing unit uses information on different colors of the plurality of three-dimensional images to be synthesized as the synthesis ratio. The image processing apparatus further includes:
A plurality of pixel value weighting means for changing the weighting of pixels when performing three-dimensional processing based on the plurality of three-dimensional processing areas set in the plurality of three-dimensional processing area setting means;
The image processing apparatus according to claim 1, wherein the synthesized three-dimensional image generation unit synthesizes the synthesized three-dimensional image based on the weighting changed by the plurality of pixel value weighting units. An image processing method for acquiring volume data, which is information of a three-dimensional space including an inspection object, and performing a three-dimensional process on the volume data to generate a three-dimensional image,
A plurality of three-dimensional processing region setting steps for setting a plurality of three-dimensional processing regions to be subjected to three-dimensional processing on the data selected from the volume data;
A plurality of three-dimensional image generation steps for generating a plurality of three-dimensional images by performing a three-dimensional process for each of the plurality of three-dimensional processing regions;
An image processing method comprising: a combined 3D image generation step of generating a combined 3D image by combining the plurality of 3D images. A program used for an image processing method for acquiring volume data, which is information of a three-dimensional space including an inspection object, and performing a three-dimensional process on the volume data to generate a three-dimensional image,
A plurality of three-dimensional processing region setting steps for setting a plurality of three-dimensional processing regions to be subjected to three-dimensional processing on the data selected from the volume data;
A plurality of three-dimensional image generation steps for generating a plurality of three-dimensional images by performing a three-dimensional process for each of the plurality of three-dimensional processing regions;
A composite 3D image generation step of generating a composite 3D image by combining the plurality of 3D images.

Images