JP2013255658A - Ultrasonic diagnostic apparatus - Google Patents

Abstract

An ultrasonic diagnostic apparatus capable of easily grasping a position on a body surface of a subject corresponding to a region of interest on an ultrasonic image is provided.
An ultrasonic transmission / reception unit transmits / receives an ultrasonic wave to / from a subject via an ultrasonic probe and generates an echo signal related to a scanning surface. The ultrasonic image generation unit 13 generates an ultrasonic image based on the echo signal. The setting means sets a region of interest on the ultrasound image. The camera 16 images the body surface of the subject and the ultrasonic probe. The first detection means detects the position of the body surface of the subject in the camera image. The second detection means detects the position of the ultrasonic probe in the image. The calculation means calculates a position on the body surface of the subject corresponding to the set region of interest based on the position of the body surface of the subject and the position of the ultrasonic probe. The display means displays the mark at the calculated position on the camera image taken by the camera.
[Selection] Figure 1

Description

  Embodiments described herein relate generally to an ultrasound diagnostic apparatus that scans the inside of a subject with ultrasound to form a tomographic image of an organ.

  The ultrasonic diagnostic apparatus is a diagnostic apparatus that displays an image of in vivo information (ultrasonic image), and is inexpensive and free of exposure compared to other diagnostic imaging apparatuses such as an X-ray diagnostic apparatus and an X-ray computed tomography apparatus. It is used as a useful device for non-invasive observation in real time. The application range of the ultrasonic diagnostic apparatus is wide, and it is applied to the diagnosis of circulatory organs such as the heart, abdomen such as the liver and kidney, peripheral blood vessels, obstetrics and gynecology, and breast cancer.

  By the way, when a tumor such as a mammary gland is diagnosed by an ultrasonic diagnostic apparatus, a mark indicating the position of the tumor is written on the body surface of the subject with a magic or the like in order to record the position of the tumor (region of interest) There is. Markers for marking are provided on a portion of the ultrasonic probe used in the ultrasonic diagnostic apparatus, particularly a linear scan type probe, which is in contact with the body surface of the subject. In consideration of the above, it is possible to write a mark at a desired position.

JP 2008-284154 A

  As described above, when writing a mark by estimating the position of a tumor or the like from the ultrasonic image and the mark of the ultrasonic probe, the position to write the mark (part on the body surface) is directly under the ultrasonic probe, The ultrasonic probe must be separated from the body surface of the subject once. If the ultrasonic probe is separated from the body surface in this way, it is difficult to accurately write a mark at the mark position of the ultrasonic probe.

  Also, in order to write a mark on the body surface of the subject, the echo jelly used at the time of ultrasonic scanning must be removed, and if such work is performed, the mark should be written at an accurate position. It becomes difficult.

  Therefore, the problem to be solved by the present invention is to provide an ultrasonic diagnostic apparatus capable of easily grasping the position on the body surface of the subject corresponding to the region of interest on the ultrasonic image.

  An ultrasonic diagnostic apparatus according to an embodiment includes an ultrasonic probe, an ultrasonic transmission / reception unit, an ultrasonic image generation unit, a setting unit, a camera, a first detection unit, a second detection unit, and a calculation. Means and display means.

  The ultrasonic transmission / reception means transmits / receives ultrasonic waves to / from the subject via the ultrasonic probe and generates an echo signal related to the scanning surface.

  The ultrasonic image generating means generates an ultrasonic image based on the echo signal.

  The setting means sets a region of interest on the ultrasonic image according to the operation of the examiner.

  The camera images the body surface of the subject and the ultrasonic probe.

  The first detection means detects the position of the body surface of the subject in the camera image taken by the camera.

  The second detection means detects the position of the ultrasonic probe in the camera image taken by the camera.

  The calculating means applies the specified region of interest based on the position of the body surface of the subject detected by the first detecting means and the position of the ultrasonic probe detected by the second detecting means. The corresponding position on the body surface of the subject is calculated.

  The display means displays a mark at the calculated position on the camera image photographed by the camera.

1 is a diagram showing a configuration of an ultrasonic diagnostic apparatus according to a first embodiment. 2 is a flowchart showing a processing procedure of ultrasonic diagnostic processing in the ultrasonic diagnostic apparatus shown in FIG. 1. 2 is a flowchart showing a processing procedure of image recognition processing in the ultrasonic diagnostic apparatus shown in FIG. 1. The figure for demonstrating simply about the calculation of the body surface curved surface of the subject. The figure for demonstrating notionally the display of the ROI projection mark in an ultrasonic diagnosing device. The figure for demonstrating notionally the display of the ROI projection mark in an ultrasonic diagnosing device. The figure for demonstrating notionally the display of the ROI projection mark in an ultrasonic diagnosing device. The figure which shows an example of the concrete display screen when a ROI projection mark is displayed. The figure which shows the structure of the ultrasonic diagnosing device which concerns on 2nd Embodiment.

  Hereinafter, each embodiment will be described with reference to the drawings.

(First embodiment)
First, the first embodiment will be described. FIG. 1 shows a configuration of an ultrasonic diagnostic apparatus according to the present embodiment. The ultrasonic diagnostic apparatus includes an ultrasonic probe 11, an ultrasonic transmission / reception unit 12, an ultrasonic image generation unit 13, a GUI 14, an ROI mark setting unit 15, a camera 16, a camera image generation unit 17, a subject coordinate conversion unit 18, An ultrasonic probe coordinate conversion unit 19, a 3D processor 20, and an ROI / camera image synthesis unit 21 are included.

  The ultrasonic probe 11 receives a drive signal from the ultrasonic transmission / reception unit 12, generates ultrasonic waves, converts a reflected wave from the subject P into an electric signal, and is provided in the piezoelectric vibrator. And a backing material for preventing propagation of ultrasonic waves from the piezoelectric vibrator to the rear. When ultrasonic waves are transmitted from the ultrasonic probe 12 to the subject P, the transmitted ultrasonic waves are successively reflected by the discontinuous surface of the acoustic impedance of the body tissue and received by the ultrasonic probe 12 as an echo signal. . The amplitude of this echo signal depends on the difference in acoustic impedance at the discontinuous surface that is to be reflected.

  Note that the subject P is provided with a mark (hereinafter referred to as a subject AR mark) 101 for detecting the position of the subject P as will be described later. Further, the ultrasonic probe 11 is provided with a mark (hereinafter referred to as an ultrasonic probe AR mark) 102 for detecting the position of the ultrasonic probe 11 as described later. The AR mark 101 for the subject is a mark different from the AR mark 102 for the ultrasonic probe.

  The ultrasonic transmission / reception unit 12 transmits / receives ultrasonic waves to / from the subject P via the ultrasonic probe 11 and generates an echo signal related to the scanning surface.

  Specifically, the ultrasonic transmission / reception unit 12 includes a pulse generator, a transmission delay unit, a pulser, and the like (not shown). The pulse generator repeatedly generates rate pulses for forming transmission ultrasonic waves at a predetermined rate frequency fr Hz (period: 1 / fr second). The transmission delay unit focuses the ultrasonic wave into a beam shape for each channel, and gives a delay time necessary for determining the transmission directivity to the rate pulse of each channel. The pulse generator applies a drive pulse to the ultrasonic probe 11 at a timing based on the rate pulse for each channel.

  The ultrasonic transmission / reception unit 12 includes a preamplifier, an A / D converter, a reception delay unit, an adder, and the like (not shown). The preamplifier amplifies the echo signal captured via the ultrasonic probe 11 for each channel. The reception delay unit gives a delay time necessary for determining the reception directivity to the amplified echo signal, and thereafter performs an addition process in an adder. By this addition, the reflection component from the direction corresponding to the reception directivity of the echo signal is emphasized, and a comprehensive beam for ultrasonic transmission / reception is formed by the reception directivity and the transmission directivity.

  The ultrasonic image generation unit 13 generates an ultrasonic image (ultrasonic tomographic image) based on the echo signal described above. Specifically, the ultrasonic image generation unit 13 receives an echo signal from the ultrasonic transmission / reception unit 12, performs logarithmic amplification, envelope detection processing, and the like, and generates data in which the signal intensity is expressed by brightness. . The ultrasonic image generation unit 13 converts this data into a B-mode image in which the intensity of the reflected wave is expressed by luminance using a predetermined lookup table. The ultrasonic image (B mode image) generated by the ultrasonic image generation unit 13 is displayed on a monitor (not shown). Here, for convenience of explanation, the processing in the B mode has been described. However, for example, processing in other modes such as color Doppler mode, M mode, continuous wave Doppler, and pulse wave Doppler mode may be appropriately combined.

  The ultrasonic image generation unit 13 converts the scanning line signal sequence of the ultrasonic scan into a scanning line signal sequence of a general video format represented by a television or the like, and generates an ultrasonic diagnostic image as a display image. To do. The ultrasonic image generation unit 13 is equipped with a storage memory for storing image data. For example, an operator (examiner) can call up an image recorded during an examination after diagnosis.

  When the ultrasound image generated by the ultrasound image generation unit 13 is displayed as described above, the inspector performs an operation of designating a region of interest (ROI) on the ultrasound image via the GUI 14. Can do. In this case, the examiner performs an operation of designating a region of interest using an input device having a pointing device such as a mouse. The examiner can designate a lesioned part such as a tumor as the region of interest.

  The ROI mark setting unit 15 sets a region of interest on the ultrasound image in accordance with the operation of the inspector described above. In this case, the ROI mark setting unit 15 sets a mark (hereinafter referred to as the ROI mark) that includes the region of interest designated by the examiner on the ultrasonic image.

  The camera 16 images the body surface (scanning part) of the subject P and the ultrasonic probe 11. The camera image generation unit 17 processes the signal output from the camera 16 to generate an image photographed by the camera 16 (hereinafter referred to as a camera image). The camera image is displayed on a monitor, for example.

  The subject coordinate conversion unit 18 detects the position of the body surface of the subject P by image recognition on the camera image. In this case, the subject coordinate conversion unit 18 extracts the AR mark 101 for the subject in the camera image, and the 3D coordinate information of the body surface of the subject P and the subject P's body mark by the AR mark 101 for the subject. A curved surface approximating the shape of the body surface (hereinafter referred to as the body surface curved surface of the subject P) is calculated.

  The ultrasonic probe coordinate converter 19 detects the position of the ultrasonic probe 11 by image recognition on the camera image. In this case, the ultrasonic probe coordinate conversion unit 19 extracts the ultrasonic probe AR mark 102 from the camera image, and calculates the 3D coordinate information of the ultrasonic probe 11 from the ultrasonic probe AR mark 102. The 3D coordinate information calculated by the ultrasonic probe coordinate conversion unit 19 identifies the position of the ultrasonic probe 11 and the direction of the ultrasonic scan surface.

  The 3D processor 20 includes information on the ROI mark set by the ROI mark setting unit 15 (such as the position of the region of interest on the ultrasonic image) and the body surface of the subject P calculated by the coordinate conversion unit 18 for the subject. The subject P corresponding to the ROI mark (region of interest) based on the 3D coordinate information, the body surface curved surface of the subject P, and the 3D coordinate information of the ultrasound probe 11 calculated by the ultrasound probe coordinate converter 19. The position on the body surface is calculated. Specifically, the 3D processor 20 calculates 3D coordinate information (3D position) of the ROI mark, and projects the ROI mark onto the body surface of the subject P based on the calculated 3D coordinate information of the ROI mark. The position of the ROI projection mark is calculated.

  The ROI / camera image combining unit 21 superimposes and displays the ROI projection mark on the camera image based on the position of the ROI projection mark calculated by the 3D processor 20. In this case, the ROI projection mark is displayed on the camera image at a position on the body surface of the subject P spatially corresponding to the region of interest designated by the examiner via the GUI 14 as described above.

  The ultrasonic transmission / reception unit 12, the ultrasonic image generation unit 13, the GUI 14, and the ROI mark setting unit 15 described above constitute, for example, an ultrasonic diagnostic apparatus main body. On the other hand, the camera image generation unit 17, the subject coordinate conversion unit 18, the ultrasonic probe coordinate conversion unit 19, the 3D processor 20, and the ROI / camera image synthesis unit 21 constitute, for example, an image recognition system.

  Hereinafter, the operation of the ultrasonic diagnostic apparatus according to the present embodiment will be described. In the ultrasonic diagnostic apparatus according to the present embodiment, ultrasonic diagnostic processing and image recognition processing are executed in association with each other.

  First, the processing procedure of the ultrasonic diagnostic processing will be described with reference to the flowchart of FIG. This ultrasonic diagnostic process is a process for mainly setting a region of interest on an ultrasonic image, and is executed by the above-described ultrasonic diagnostic apparatus body.

  As described above, the ultrasonic transmission / reception unit 12 transmits / receives ultrasonic waves to / from the subject P via the ultrasonic probe 11 (step S1). Thereby, the ultrasonic transmission / reception unit 12 generates an echo signal related to the scanning plane.

  The ultrasonic image generation unit 13 generates an ultrasonic image based on the echo signal generated from the ultrasonic transmission / reception unit 12. The ultrasonic image generated by the ultrasonic image generation unit 13 is displayed on the monitor or the like for the examiner (step S2).

  Next, the examiner can perform an operation of designating a region of interest on the ultrasonic image via the GUI 14. In this case, the examiner designates the position (boundary) of the region of interest using, for example, a pointing device. The ROI mark setting unit 15 sets an ROI mark on the ultrasound image that includes the region of interest designated by the inspector in accordance with the operation of the inspector (step S3).

  Note that the ROI mark information (ROI mark position, etc.) set by the ROI mark setting unit 15 is passed to the 3D processor 20 and used in the image recognition process executed in association with the ultrasonic diagnosis process described here. It is done.

  Next, the processing procedure of the image recognition process will be described with reference to the flowchart of FIG. This image recognition process is a process for displaying the ROI projection mark mainly on the camera image, and is executed by the above-described image recognition system.

  In the present embodiment, it is assumed that at least three AR marks 101 for the subject are attached to the body surface of the subject P so that the position (and orientation, etc.) of the body surface of the subject P can be detected. . Similarly, it is assumed that the ultrasonic probe 11 is provided with at least three ultrasonic probe AR marks 102 so that the position of the ultrasonic probe 11 (and the direction of the scan surface, etc.) can be detected. The AR mark 101 for the subject and the AR mark 102 for the ultrasonic probe are different marks.

  The subject AR mark 101 and the ultrasonic probe AR mark 102 may be in any form that can detect the position of the body surface of the subject P and the position of the ultrasonic probe 11. Specifically, the subject AR mark 101 and the ultrasonic probe AR mark 102 may each be provided with four or more. The plurality of AR marks 101 for the subject may be different from each other, and similarly, the plurality of AR marks 102 for the ultrasonic probe may be different from each other.

  The camera 16 is disposed at a position where the region including the body surface of the subject P (subject AR mark 101) and the ultrasonic probe 11 (ultrasonic probe AR mark 102) can be photographed. .

  First, the camera image generation unit 17 displays a camera image by processing a signal output from the camera 16 (step S11). The camera image is transferred to the object coordinate conversion unit 18 and the ultrasonic probe coordinate conversion unit 19.

  The subject coordinate conversion unit 18 extracts (recognizes) the subject AR mark (position) 101 in the camera image delivered from the camera image generation unit 17 by image recognition (step S12).

  The subject coordinate conversion unit 18 determines the 3D coordinate information of the body surface of the subject P (near the scanning portion by the ultrasonic probe 11) and the body surface of the subject P based on the extracted AR mark 101 for the subject. A curved surface is calculated (step S13).

  In the calculation of the body surface curved surface of the subject P, as shown in FIG. 4, for example, assuming an approximate shape of the body surface of the subject P, an appropriate recent curved surface is obtained from the AR mark 101 for the subject. Set. For example, when the breast is observed, the shape of the body surface of the subject P is estimated from the subject AR mark 101 assuming a basic model such as a sphere or an elliptical sphere.

  Returning to FIG. 3 again, the ultrasonic probe coordinate conversion unit 19 extracts (recognizes) the ultrasonic probe AR mark (position) 102 in the camera image delivered from the camera image generation unit 17 by image recognition ( Step S14).

  The ultrasonic probe coordinate conversion unit 19 calculates 3D coordinate information (the position of the ultrasonic probe 11 and the direction of the ultrasonic scan surface) of the ultrasonic probe 11 based on the extracted AR mark 102 for the ultrasonic probe. (Step S15).

  The 3D coordinate information of the body surface of the subject P calculated in step S13 and the body surface curved surface of the subject P and the 3D coordinate information of the ultrasonic probe 11 calculated in step S15 are passed to the 3D processor 20. It is. Here, the information passed to the 3D processor 20 includes the 3D coordinate information of the body surface of the subject P, the body surface curved surface of the subject P, and the ultrasound when the ROI mark is set in the ultrasound diagnostic processing described above. 3D coordinate information of the probe 11.

  The 3D processor 20 calculates 3D coordinate information (3D position) of the ROI mark based on the ROI mark information set in the above-described ultrasonic diagnostic processing and the 3D coordinate information of the ultrasonic probe 11, for example (step). S16).

  Next, the 3D processor 20 is based on the calculated 3D position of the ROI mark, the 3D coordinate information of the body surface of the subject P, the body surface curved surface of the subject P, and the 3D coordinate information of the ultrasonic probe 11. Then, the position of the ROI projection mark obtained by projecting the ROI mark onto the body surface of the subject P is calculated (step S17). The position of the ROI projection mark calculated here is, for example, the position on the body surface when projected from the 3D position of the ROI mark in the camera direction (that is, the body of the subject P corresponding to the region of interest specified by the examiner). Position on the table).

  The ROI / camera image combining unit 21 superimposes the ROI projection mark on the position of the ROI projection mark calculated by the 3D processor on the camera image. As a result, the ROI / camera image combining unit 21 displays the ROI projection mark on the camera image (step S18).

  Here, the display of the ROI projection mark in the ultrasonic diagnostic apparatus according to the present embodiment will be conceptually described with reference to FIGS.

  First, as shown in FIG. 5, ultrasonic waves are transmitted / received to / from the subject P via the ultrasonic probe 11 to generate an echo signal related to the scanning surface, and an ultrasonic image generated based on the echo signal. Is displayed.

  At this time, the ROI mark 103 is set on the ultrasonic image in accordance with the operation of designating the region of interest of the examiner.

  When the ROI mark 103 is set in this way, the position of the body surface (3D coordinate information and body surface curved surface) of the subject P and the position of the ultrasonic probe 11 (3D coordinate information) are determined by the image recognition process described above. Detected.

  Next, the 3D position of the ROI mark 103 is calculated according to the information of the ROI mark 103 (the position of the ROI mark 103 on the ultrasonic image and the like) and the positional relationship between the body surface of the subject P and the ultrasonic probe 11. Then, the position of the ROI projection mark (the position on the body surface when the ROI mark 103 is projected onto the body surface of the subject P) is calculated. In this case, as shown in FIG. 6, the ROI projection mark 104 is displayed on the camera image based on the calculated position of the ROI projection mark.

  When the ultrasound probe 11 overlaps the ROI projection mark 104 (position) on the camera image, as shown in FIG. 7, not all of the ROI projection mark 104 is displayed, but overlaps with the ultrasound probe 11. It is also possible to display only the parts that do not become necessary.

  FIG. 8 shows an example of a specific display screen when the ROI projection mark is displayed. In the example illustrated in FIG. 8, the ultrasonic image 201 and the camera image 202 are displayed side by side on the display screen.

  In this case, on the ultrasonic image 201, the ROI mark 103 is set according to the operation of designating the region of interest of the examiner as described above. When the ROI mark 103 is set on the ultrasonic image 201 in this way, the ROI projection mark 104 is displayed on the camera image 202 by the image recognition process as described above.

  By checking such a screen, the examiner designates the region of interest including the tumor or the like on the ultrasonic image 201, and the position of the subject P corresponding to the region of interest (that is, the ROI). The position of the projection mark 104 can be confirmed.

  As described above, in the present embodiment, an ultrasonic image is generated based on an echo signal generated by transmission / reception of an ultrasonic wave to / from the subject P via the ultrasonic probe 11, and the ultrasonic wave is generated according to the operation of the examiner. A region of interest on the image is set, the position of the body surface of the subject P and the position of the ultrasound probe 11 in the camera image taken by the camera 16 are detected, and the position of the body surface of the subject P and the ultrasound are detected. Based on the position of the probe 11, the examiner is interested in the ultrasonic image by displaying the mark (ROI projection mark) at the position on the body surface of the subject P corresponding to the region of interest on the camera image. The position on the body surface of the subject P corresponding to the region can be easily grasped on the camera image.

  That is, in the present embodiment, the body surface of the subject P on the camera image is not directly written on the body surface of the subject P with a magic or the like, but the position of the lesioned part (tumor etc.) observed on the ultrasound image is written. For example, even when the ultrasonic probe 11 is separated from the body surface of the subject P, the ROI projection mark on the camera image is confirmed to confirm the subject P's position. It is possible to actually mark the exact position on the body surface with a magic or the like.

  Further, in the present embodiment, it has been described that only the ROI projection mark is superimposed and displayed on the camera image. However, in addition to the ROI projection mark, for example, in the vicinity of the ROI projection mark, an actual female method is used. A mark (arbitrary mark) or the like indicating a location where the character is inserted may be displayed. The location where this arbitrary mark is displayed may be designated on the camera image by, for example, an inspector. In addition, for example, character information (such as a memo) other than the mark may be displayed on the camera image.

  Further, for example, by storing the position information (3D coordinate information) of the ROI mark and the position information (3D coordinate information) of the body surface of the subject P, the body of the subject P can be obtained without performing an ultrasonic examination again. The ROI projection mark can be displayed even when the subject P is imaged from any direction with the subject AR mark 101 attached to the table as a marker.

  Further, in the present embodiment, the camera 16 may be configured to be fixed to a goggle type display worn by an inspector, for example. In this case, the ultrasonic image and the camera image are displayed on a goggle type display worn by the examiner. As a result, the examiner can see the subject P and the ROI projection mark that are actually viewed in an overlapping manner. The position of the ROI projection mark is adjusted following the angle at which the examiner views the subject P.

  Further, the camera 16 may be fixed to the ultrasonic probe 11 and the position of the ultrasonic probe 11 may be detected based on the position of the camera 16. In this case, although the absolute position of the body surface of the subject P cannot be measured, the ROI projection mark can be displayed on the part imaged by the camera 16 from the relative position to the ultrasonic probe 11.

  Furthermore, in the present embodiment, it has been described that the position of the ultrasonic probe 11 is detected by the AR mark 102 for the ultrasonic probe attached to the ultrasonic probe 11. However, for example, the ultrasonic probe 11 is incorporated in the ultrasonic probe 11. It is also possible to adopt a configuration in which the position of the ultrasonic probe 11 is detected by a magnetic position sensor. Note that the position of the body surface of the subject P may be detected by the AR mark 101 for the subject attached to the body surface of the subject P as described above.

(Second Embodiment)
Next, a second embodiment will be described. FIG. 9 shows the configuration of the ultrasonic diagnostic apparatus according to this embodiment. The same parts as those in FIG. 1 described above are denoted by the same reference numerals, and detailed description thereof is omitted. Here, the parts different from the first embodiment will be mainly described.

  This embodiment is different from the first embodiment described above in that the boundary of the region of interest (lesion) is automatically extracted according to the movement of the ultrasonic probe 11.

  As shown in FIG. 2, the ultrasonic diagnostic apparatus according to the present embodiment includes an ROI automatic detection unit 22, a 3D processor 23, and an ROI / camera image synthesis unit 24.

  The ROI automatic detection unit 22 is arranged on an ultrasonic image that changes according to the movement (movement) of the ultrasonic probe 11 after the ROI mark is set by the ROI mark setting unit 15 (the region of interest is designated by the examiner). The boundary of the region of interest is automatically extracted. As a result, the ROI automatic detection unit 22 can detect information on the three-dimensional region of interest (its contour).

  The 3D processor 23 obtains the position of the three-dimensional region of interest based on the information of the three-dimensional region of interest detected by the ROI automatic detection unit 22 and the 3D coordinate information of the ultrasonic probe 11. Based on the obtained position of the three-dimensional region of interest, the 3D processor projects the position of the ROI projection mark (on the body surface of the subject P) onto the body surface of the subject P. Position).

  The ROI / camera image synthesizing unit 24 performs a three-dimensional display on the camera image based on the position of the ROI projection mark calculated by the 3D processor 23 (the position of the three-dimensional region of interest projected onto the body surface of the subject P). Mark (ROI projection mark) is displayed.

  The operation (processing) other than the point that the ROI automatic detection unit 22 detects the information of the three-dimensional region of interest and the ROI / camera image synthesis unit 24 displays the three-dimensional mark is described above. Since it is the same as that of Embodiment 1, the detailed description is abbreviate | omitted.

  As described above, in the present embodiment, information on the three-dimensional region of interest is obtained by automatically extracting the boundary of the region of interest on the ultrasonic image that changes according to the movement (movement) of the ultrasonic probe 11. Compared with the first embodiment described above, it corresponds to the region of interest by detecting and displaying a three-dimensional mark at a position on the body surface of the subject P corresponding to the three-dimensional region of interest. It becomes possible to grasp the position of the subject P on the body surface more accurately.

  In the above-described first embodiment, the planar mark (ROI projection mark) is described based on the ROI mark set on one ultrasonic image. However, for example, an ultrasonic probe is used. When the examiner designates the contours of a region of interest including a lesioned part such as a tumor that is similarly observed on a plurality of ultrasonic images that change in accordance with the movement of 11, the three-dimensional region of interest (lesion It is also possible to detect the contour of the part. In this case, also in the first embodiment described above, a three-dimensional mark can be displayed as in the present embodiment.

  According to the embodiment described above, it is possible to provide an ultrasonic diagnostic apparatus that can easily grasp the position on the body surface of the subject corresponding to the region of interest on the ultrasonic image.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 11 ... Ultrasonic probe, 12 ... Ultrasonic transmission / reception part, 13 ... Ultrasound image generation part, 14 ... GUI, 15 ... ROI mark setting part, 16 ... Camera, 17 ... Camera image generation part, 18 ... Coordinate transformation for object , 19 ... Ultrasonic probe coordinate conversion unit, 20, 23 ... 3D processor, 21, 24 ... ROI / camera image synthesis unit, 22 ... ROI automatic detection unit.

Claims (8)

An ultrasonic probe;
Ultrasonic transmission / reception means for transmitting / receiving ultrasonic waves to / from the subject via the ultrasonic probe and generating echo signals related to the scanning plane;
Ultrasonic image generating means for generating an ultrasonic image based on the echo signal;
A setting means for setting a region of interest on the ultrasonic image in accordance with the operation of the examiner;
A camera that images the body surface of the subject and the ultrasound probe;
First detection means for detecting the position of the body surface of the subject in a camera image photographed by the camera;
Second detecting means for detecting a position of the ultrasonic probe in a camera image photographed by the camera;
Based on the position of the body surface of the subject detected by the first detection means and the position of the ultrasonic probe detected by the second detection means, the subject corresponding to the set region of interest is set. First calculating means for calculating a position on the body surface of the specimen;
An ultrasonic diagnostic apparatus comprising: display means for displaying a mark at the calculated position on a camera image photographed by the camera. The first detection means detects the position of the body surface of the subject by image recognition with respect to a camera image taken by the camera,
The ultrasonic diagnostic apparatus according to claim 1, wherein the second detection unit detects a position of the ultrasonic probe by image recognition with respect to a camera image photographed by the camera. The body surface of the subject has a mark for detecting the position of the body surface of the subject,
The first detection means detects a position of the body surface of the subject by extracting a mark attached to the body surface of the subject by image recognition with respect to an image photographed by the camera. The ultrasonic diagnostic apparatus according to claim 2. A mark for detecting the position of the ultrasonic probe is attached to the surface of the ultrasonic probe,
The second detection means detects a position of the ultrasonic probe by extracting a mark attached to the ultrasonic probe by image recognition with respect to an image photographed by the camera. Item 3. The ultrasonic diagnostic apparatus according to Item 2. By extracting a boundary of the set region of interest on an ultrasound image that changes according to the movement of the ultrasound probe by the examiner, the body surface of the subject corresponding to the three-dimensional region of interest is extracted. A second calculating means for calculating the position;
The ultrasonic diagnostic apparatus according to claim 1, wherein the displayed mark includes a three-dimensional mark based on the three-dimensional region of interest.   The ultrasonic diagnostic apparatus according to claim 1, wherein the second detection unit includes a position sensor that is attached to the ultrasonic probe and detects a position of the ultrasonic probe. The camera is fixed to the ultrasonic probe, images the body surface of the subject,
The ultrasonic diagnostic apparatus according to claim 1, wherein the second detection unit detects a position of the ultrasonic probe based on a position of the camera. The display means includes a goggle type display worn by an examiner,
The ultrasonic diagnostic apparatus according to claim 1, wherein the camera is fixed to the goggle type display.

Images