EP1129426A1 - System for detection of malignancy in pulmonary nodules - Google Patents
System for detection of malignancy in pulmonary nodulesInfo
- Publication number
- EP1129426A1 EP1129426A1 EP99958770A EP99958770A EP1129426A1 EP 1129426 A1 EP1129426 A1 EP 1129426A1 EP 99958770 A EP99958770 A EP 99958770A EP 99958770 A EP99958770 A EP 99958770A EP 1129426 A1 EP1129426 A1 EP 1129426A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- nodule
- neural network
- training
- artificial neural
- mechanism configured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
Definitions
- the invention relates generally to a method and system for the computerized analysis of radiographic images, and more specifically, to the determination of the likelihood of malignancy in pulmonary nodules using artificial neural networks (ANNs).
- ANNs artificial neural networks
- the present invention generally relates to computerized techniques for automated analysis of digital images, for example, as disclosed in one or more of U.S. Patents 4,839,807; 4,841,555; 4,851,984; 4,875,165; 4,907,156; 4,918,534; 5,072,384; 5,133,020; 5,150,292; 5,224,177; 5,289,374; 5,319,549; 5,343,390; 5,359,513; 5,452,367; 5,463,548; 5,491,627; 5,537,485; 5,598,481; 5,622,171; 5,638,458; 5,657,362; 5,666,434; 5,673,332; 5,668,888; 5,740,268; 5,790,690; and 5,832,103; as well as U.S.
- the present invention includes the use of various technologies referenced and described in the above-noted U.S. Patents and Applications, as well as described in the references identified in the appended APPENDIX and cross-referenced throughout the specification by reference to the corresponding number, in brackets, of the respective references listed in the APPENDIX, the entire contents of which, including the related patents and applications listed above and the references listed in the APPENDIX, are incorporated herein by reference. Discussion of the Background
- solitary pulmonary nodule is a common finding on a chest radiograph
- the differential diagnosis of a solitary pulmonary nodule or chest radiograph is often a difficult task for radiologists [1-8].
- a solitary pulmonary nodule may be the first sign of lung cancer, especially in its early stage, most patients undergo a further diagnostic evaluation that may include an imaging study with computed tomography (CT) [1].
- CT computed tomography
- Malignant diseases are estimated to occur in about 20% of patients with solitary pulmonary nodules in the population [9].
- the majority of radiographically detected pulmonary nodules are benign [3,8,10-14].
- CT has become a major diagnostic method to differentiate pulmonary nodules in recent years, a large number of CT examinations have been performed for benign cases that were suspected of being malignant.
- a survey was conducted to obtain estimates for the relative numbers (percentages) of malignant and benign cases that were performed for chest CT study under the investigation of a solitary pulmonary nodule. The survey was performed at the University of Chicago Hospital and at four Hospitals in Japan (University of Occupational and Environmental Health Hospital, Fukuoka; Nagasaki University Hospital, Nagasaki; Iwate Prefectural Central Hospital, Morioka; and Tokyo Metropolitan Hospital, Tokyo).
- pre-CT diagnosis included a lung nodule/lung mass
- some of the cases may have involved suspected benign diseases; however, it was assumed that most of these cases involved suspected malignancy.
- Table 1 shows the summary of the survey on the final diagnosis of solitary pulmonary nodules which underwent chest CT. Fifty-five out of 133 cases (or 41.4%) indicated malignant nodules including primary lung cancer and pulmonary metastases. Sixty-four cases (48.1%) indicated benign conditions including benign diseases and "negative" cases that had no apparent lung abnormality as a result of CT examination. Fourteen cases had inconclusive final diagnoses. The results obtained in this survey show that a large fraction of patients who underwent chest CT examination were ultimately identified as having benign conditions. Accordingly, some of the CT examinations may have been avoided if these benign conditions were diagnosed accurately and/or confidently on the initial chest radiographs.
- Computer schemes capable of providing objective information on the nature of pulmonary nodules may aid radiologists in their classification of pulmonary nodules.
- Various computerized schemes have been investigated for characterizing pulmonary nodules.
- an object of this invention is to provide a new and improved method and system for the analysis of the likelihood of malignancy in solitary pulmonary nodules using artificial neural networks.
- Another object of the present invention is to provide a method and system for implementing a computer-aided diagnostic (CAD) technique to assist radiologists in distinguishing benign and malignant lung nodules.
- CAD computer-aided diagnostic
- Another object of this invention is to provide a method and system for assisting radiologists in accurately identifying benign pulmonary nodules.
- the method includes obtaining a digital outline of a nodule; generating objective measures corresponding to physical features of the outline of the nodule; applying the generated objective measures to an artificial neural network (ANN); and determining a likelihood of malignancy of the nodule based on an output of the ANN.
- ANN artificial neural network
- Techniques include the use of ANNs to merge subjective features extracted by radiologists to determine the likelihood of malignancy of solitary pulmonary nodules. Additional techniques include computerized extraction of objective measures of lung nodules that are correlated to the subjective features seen by radiologists, and the use of ANNs to estimate the likelihood of malignancy by merging the objective measures. The performance of the ANNs is evaluated by means of receiver operating characteristic (ROC) analysis. The performance of radiologists is evaluated in classifying benign and malignant nodules for comparison with the computerized methods.
- ROC receiver operating characteristic
- the present invention thus addresses the problems associated with the conventional diagnosis of pulmonary nodules.
- the method and system of the invention using ANNs to merge subjective data obtained manually or objective data obtained with automated techniques, is thus able to estimate the likelihood of malignancy. This estimate assists radiologists in confidently and accurately identifying benign nodules, thereby helping to reduce the number of unnecessary CT examinations (i.e., CT examinations performed on patients with benign nodules).
- Figure 1(a) is a flowchart of the method used to analyze the likelihood of malignancy in pulmonary nodules according to the present invention
- Figure 1(b) is an image of a score sheet 10 to be used by radiologists to subjectively characterize lung nodules;
- Figures 2(a) and 2(b) are respective images of (a) a malignant nodule and (b) a benign nodule;
- Figure 2(c) is an image of a hand-drawn outline delineating the malignant nodule of Figure 2(a);
- Figure 2(d) is an image of a hand-drawn outline delineating the benign nodule of Figure 2(b);
- Figure 2(e) is an image of an ellipse calculated to fit the outline of the malignant nodule delineated (extracted) in Figure 2(c);
- Figure 2(f) is an image of an ellipse calculated to fit the outline of the benign nodule delineated (extracted) in Figure 2(d);
- Figure 3(a) is a one-dimensional representation of the nodule outline of Figure 2(c) as the distance from sample points distributed with equal intervals on the calculated ellipse of Figure 2(e);
- Figure 3(b) is a one-dimensional representation of the nodule outline of Figure 2(d) as the distance from sample points distributed with equal intervals on the calculated ellipse of Figure 2(f);
- Figure 4(a) is an illustration of an artificial neural network (ANN) for determining the likelihood of malignancy in a pulmonary nodule in accordance with the present invention
- Figures 4(b), 4(c), and 4(d) are respective graphs, for attending radiologists (4(b)), radiology residents (4(c)), and all radiologists (4(d)), of receiver operating characteristic (ROC) curves showing how accurately benign and malignant nodules were identified using an ANN trained with selected subjective features and an ANN trained with all subjective features quantified by the respective radiologists.
- ROC receiver operating characteristic
- Figures 5(a), 5(b), and 5(c) are respective graphs comparing ROC curves of (a) attending radiologists versus an ANN trained using selected subjective features quantified by the attending radiologists, (b) radiology residents versus an ANN trained using selected subjective features quantified by the radiology residents, and (c) the average performance of all radiologists versus an ANN trained using selected subjective features quantified by all radiologists, in distinguishing between benign and malignant nodules;
- Figures 6(a) and 6(b) are graphs showing the respective relationships between (a) the root mean square (RMS) value and subjective rating of marginal irregularity, and (b) the standard deviation of pixel values and subjective rating of homogeneity;
- Figures 7(a), 7(b), 7(c), and 7(d) are graphs showing the respective relationships between (a) effective diameter and degree of ellipticity, (b) standard deviation of pixel values and average pixel value, (c) degree of circularity and RMS variation, (d) average edge gradient and degree of elliptical irregularity, for malignant and benign nodules;
- Figure 8 is a graph of a series of ROC curves showing that an ANN trained with objective measures quantified by a computer outperforms both radiologists and an ANN trained with subjective features quantified by radiologists, when distinguishing between benign and malignant nodules;
- Figure 9 is a schematic illustration of a general purpose computer 100 programmed according to the teachings of the present invention.
- the overall technique includes an initial acquisition of a database of digital medical images (training images) in step SI .
- the digital medical images include images of pulmonary nodules.
- step S2 the approximate outlines (i.e., approximate contours) of the nodules are extracted (i.e., delineated) manually by a radiologist.
- step S3 selected features of the nodules shown in the digital medical images are quantified.
- the selected features may include clinical parameters, subjective features, and/or objective measures.
- the quantification of the selected features may be performed subjectively, by humans, and/or objectively, using automated techniques described below. If none of the selected features are determined based on the extracted outline of the nodule, then step S2 may be skipped.
- an artificial neural network (ANN) is trained based on the selected features quantified in step S3.
- the likelihood of malignancy for a candidate pulmonary nodule may be determined in steps S5 through S7.
- the selected features are quantified for the candidate nodule.
- the quantified features are input to the respective input nodes of an ANN.
- an output unit of the ANN determines the likelihood of malignancy of the candidate nodule based on the quantified features input in step S6.
- a database was constructed from 56 chest radiographs selected from the cases that were used for development of computerized schemes for detection of lung nodules [29, 30]. Solitary pulmonary nodules larger than 3 cm were excluded in this study. None of the nodules showed calcification using CT, nor were scarlike linear opacities visible. The final diagnosis was established pathologically, and for some benign nodules, a presumed diagnosis of benign etiology was made because of no change or decrease in nodule size over a 2 year period. The 56 chest radiographs included 34 malignant nodules, all of which were pathologically proven primary bronchogenic carcinoma.
- the radiographs further included 22 benign lesions, 2 of which were classified as pulmonary hamartoma, 12 of which were classified as granuloma, 7 of which were classified as inflammatory lesion, and 1 which was classified as pulmonary infarction.
- the 56 chest radiographs were obtained in 33 women and 23 men who ranged in age from 24 to 86 years (mean, 58.4 years).
- Chest radiographs were digitized with a laser scanner (model number 2905 manufactured by Abe Sekkei of Tokyo, Japan) with a pixel size of 0.175 mm and a 10- bit gray scale (1,024 gray levels). In an alternative embodiment, however, a database of more or fewer radiographs is used.
- Radiological findings on pulmonary nodules provided eight subjective features, including nodule size, nodule shape, marginal irregularity, spiculation, border definition, lobulation, nodule density (contrast), and homogeneity. These features are described by way of example in Figure 1(b) which shows a score sheet 10 to be used in subjectively characterizing the lung nodules.
- the nodules' sizes were measured by using a ruler.
- the variations in measured nodule sizes between different observers was mainly due to the variation in subjective judgments on nodule edges.
- Seven radiologists (4 attending radiologists ("attendings") and 3 radiology residents ("residents")) characterized the features of each nodule independently using a score sheet, such as the score sheet 10, with scales from 1 to 5.
- Nodule shape was scored from round to elongated; marginal irregularity was scored from smooth to irregular; spiculation was scored from non-spiculated to spiculated; border definition was scored from well-defined to ill- defined; lobulation was scored from non-lobulated to lobulated; nodule density (contrast) was scored from low density to high density; homogeneity was scored from homogeneous to inhomogeneous.
- the score sheet included images of two extreme examples (i.e., an example of a "1" and a "5") for each feature.
- the diagrams served as a scoring guide for the radiologists; for example, an image of a non-spiculated nodule (i.e., a "1") and a spiculated nodule (i.e., a "5") were provided to help assess the degree of spiculation.
- Table 2 shows examples of a radiologist's subjective ratings for the eight subjective radiological features for the malignant and benign pulmonary nodules shown in Figures 2(a) and 2(b), respectively. To eliminate the bias of the knowledge of "truth,” all radiologists rated each nodule without knowledge of the correct diagnosis.
- the following twelve features were selected for computer characterization of pulmonary nodules that were extracted from digitized chest radiographs: effective diameter; degree of circularity; degree of ellipticity; root mean square (RMS) variation; first moment of power spectrum; degree of irregularity; average gradient; radial gradient index (RGI); tangential gradient index (TGI); line enhancement index (LEI); average pixel value; and standard deviation of pixel values.
- RMS root mean square
- RMS root mean square
- first moment of power spectrum degree of irregularity
- average gradient radial gradient index
- RGI radial gradient index
- TGI tangential gradient index
- LEI line enhancement index
- average pixel value and standard deviation of pixel values.
- the objective measures are quantified or determined based on the outline (or contour) of the nodules manually extracted by a first radiologist.
- Figure 2(c) shows the hand-drawn outlines (i.e., margins) for the malignant nodule of Figure 2(a).
- Figure 2(d) shows the hand- drawn outlines for the benign nodule of Figure 2(b).
- a second radiologist independently extracted a second set of nodule outlines to examine the variation in these objective measures derived from the outlines. The radiologists were not informed about correct diagnosis in order to avoid a bias to the outlines.
- the effective diameter provides an objective measure of the nodule size.
- the effective diameter [31, 32] is the diameter of an equivalent circle having the same area as that defined by the outline of the nodule.
- the degree of circularity provides an objective measure of the nodule shape.
- the degree of circularity is the ratio of the area of the nodule overlapped with the equivalent circle, to the total area of the nodule [31, 32].
- the degree of ellipticity also provides an objective measure of the nodule shape.
- the degree of ellipticity is determined in the same manner as that for the degree of circularity, except that an ellipse approximating the nodule outline is calculated using a least squares fit [33, 34].
- Figure 2(e) shows an ellipse calculated to fit to the outline of the malignant nodule of Figure 2(a).
- Figure 2(f) shows an ellipse calculated to fit to the outline of the benign nodule of Figure 2(b).
- the definition of marginal irregularity includes two independent factors: the magnitude and the coarseness (or fineness) of irregular edge patterns.
- the edge pattern is the distance from the nodule outline to the calculated ellipse, as illustrated in Figures 3(a) and 3(b) for the malignant and benign nodules of Figures 2(a) and (b), respectively.
- the irregular edge pattern was analyzed using Fourier transformation.
- the RMS variation and the first moment of power spectrum [35] were each determined to provide separate measures of marginal irregularity.
- the degree of irregularity [32] provides another measure of marginal irregularity.
- the degree of irregularity is one minus the ratio of (a) the perimeter (i.e., circumference) of the ellipse used to determine degree of ellipticity to (b) the length of the extracted outline.
- Border definition is quantified by the average gradient, which is obtained by the average edge gradients over a selected border region.
- the border region is the area between an outer limit defined by the fitted ellipse plus twice the RMS variation and an inner limit defined by the fitted ellipse minus twice the RMS variation.
- the border region has a width of four times the RMS variation as measured from the center of the calculated ellipse.
- RGI provides an objective measure of the spiculation of a nodule.
- the RGI is the average absolute value of the radial edge gradients projected in a direction along the radial direction [42].
- the radial direction is a line from the center of mass of the calculated ellipse. For each pixel in the border region, the absolute value of the radial edge gradient projected in a direction along the radial direction is determined. The resulting absolute values are summed and averaged to determine the RGI according to the following formula:
- P is the pixel or image point
- L is the set of pixels in the border region
- D x is the gradient in the x-direction
- D y is the gradient in the y-direction
- ⁇ is the angle between the gradient vector and the radial direction.
- TGI provides another measure of the spiculation of a nodule.
- the TGI is obtained from a tangential component of the edge gradient at a pixel, which is projected in a direction pe ⁇ endicular to the radial direction. Accordingly, the following formula is used to determine TGI:
- LEI provides yet another measure of spiculation and indicates the magnitude of line pattern components obtained by means of a line enhancement filter [36], in a direction within 45 degrees from the radial direction.
- LEI indicates the number of pixels in the border region that form part of a line pattern having a direction within 45 degrees of the radial direction, divided by the total number of pixels in the border region. Whether a pixel forms part of a line pattern (i.e., whether a pixel is a line pattern component) is determined by the line enhancement filter [36].
- the average pixel value provides a measure of the optical density of a nodule.
- the average pixel value is the average pixel value (i.e., gray level) over the nodule as defined by the extracted outline.
- the standard deviation of pixel values over the nodule provides a measure of the homogeneity of the nodule.
- the standard deviation is the standard deviation of pixel values over the nodule as defined by the extracted outline.
- Figure 4(a) is a diagram of a three-layer, feed-forward artificial neural network (ANN) trained with a back propagation algorithm [37] and used to determine the likelihood of malignancy for a pulmonary nodule.
- ANN feed-forward artificial neural network
- the features input (applied) to the ANN included two clinical parameters (patient's age and gender) and either the eight subjective radiological features quantified by radiologists or selected of the physical measures (objective features) quantified using computer analysis. The same features are used to test and train each ANN.
- the number of input units equals the number of features input to the ANN.
- the number of hidden units may also vary but is preferably half the number of input units.
- the basic structure of the neural network included 10 input units la, lb, lc, Id, le, If, lg, lh, li, lj; 5 hidden units 3a, 3b, 3c, 3d, 3e; and an output unit 5.
- the input data obtained from clinical parameters, subjective ratings by radiologists, and physical measures obtained by using a computer were normalized in the range of 0 to 1.
- the training and testing of the neural network was performed using a round-robin (or leave-one-out) method [24].
- the threshold may be set at 0.5, the threshold is preferably set at 0.1 or 0.05 so that malignant nodules are correctly identified.
- low thresholds increase the sensitivity of the ANN with regard to classifying malignant nodules, at the risk of increased false positives.
- Radiologists To evaluate the performance of radiologists in classifying pulmonary nodules, seven radiologists (4 attendings and 3 residents) participated in the observer study. Each observer (i.e., participating radiologist) was presented with a chest radiograph and two clinical parameters (patient's age and gender). Each observer was then asked to provide his or her confidence level regarding the likelihood of malignancy by using a continuous rating scale with a line checking method [29]. Confidence ratings of "definitely benign” and "definitely malignant" were marked above the left and the right end, respectively, of the line. Radiographs were presented in random order. ROC analysis was employed for comparison of the performance of observers with those of the computerized methods in distinguishing between benign and malignant nodules.
- Table 3 shows the performance index, Az, when distinguishing between benign and malignant nodules, of the ANN trained with image features extracted by each radiologist separately, and by all radiologists combined.
- Az the performance index
- the performance of the ANN with features extracted by radiology residents were much lower than that of attending radiologists.
- the selected features were patient age, nodule size, marginal irregularity, border definition, nodule density (contrast), and homogeneity.
- ANNs it is generally desirable for ANNs to achieve a high performance even when only a small number of essential input units are applied.
- 6 features including patient's age, the nodule size, marginal irregularity, spiculation, border definition, and homogeneity were selected.
- the average Az value of 0.761 for all 7 radiologists with 6 selected subjective features was statistically significantly greater than that (0.710) with all 10 subjective features (p ⁇ 0.0007).
- Figures 4(a), 4(b), 4(c), and 4(d) show ROC curves obtained by the ANN trained with 10 features (2 clinical parameters (age and gender) and all 8 subjective features) and an ANN trained with 6 features (1 clinical feature (age) and five subjective features (nodule size, marginal irregularity, spiculation, border definition, and homogeneity)) as input data.
- the average Az value for the ANN with 6 features was greater than those with 10 features.
- Figures 5(a), 5(b), and 5(c) compare the performances of the radiologists in differentiating pulmonary nodules with the ANN trained with six selected subjective features (1 clinical feature (age) and five subjective features (nodule size, marginal irregularity, spiculation, border definition, and homogeneity)).
- the average performance of the ANN when trained with the six subjective features obtained from attendings was slightly greater than the average performance of the attendings.
- the average performance of the ANN when trained with the six subjective features obtained from residents was comparable to the average performance of the residents.
- the performance of the ANN with the features extracted by all radiologists is also shown in Table 3.
- the Az value for the ANN trained and tested with the subjective features obtained from all radiologists was comparable to the average Az value for ANNs trained with the features obtained by each attending radiologist when the ANN used gender, age, and all 8 subjective features. However, when the ANN used age and five selected subjective features, the Az value for the ANN trained with features obtained from all radiologists was lower than the average Az value for ANNs trained with features obtained from each attending radiologist.
- Figures 6(a) and 6(b) respectively show (a) the relationships between the RMS value and subjective ratings of marginal irregularity, and (b) the relationships between the standard deviation of pixel values and subjective ratings of homogeneity.
- the small squares and vertical bars in Figures 6(a) and 6(b) indicate the average and the standard deviation, respectively, of each physical measure obtained from all nodules included in each of five different subjective ratings.
- Figures 7(a), 7(b), and 7(c) each show the relationships between two selected image features of pulmonary nodules. Although a considerable overlap between the malignant and benign pulmonary nodules is observed in general, there is also a trend, which would discriminate malignant and benign nodules, between the distribution of two groups. For example, in Figure 7(a) malignant nodules tend to have a larger effective diameter and smaller degree of ellipticity than benign nodules. This result appears to agree with general characteristics of lung nodules that malignant nodules are larger than benign nodules, and that the shape of benign nodules tends to be round.
- Figure 7(d) shows that malignant nodules tend to have a larger average edge gradient and a larger degree of elliptical irregularity than benign nodules, which indicates potential for discriminating benign from malignant nodules. This tendency also agrees with general characteristics that malignant nodules tend to contain spiculations and irregular margins.
- RMS RMS value
- FM first moment of power spectrum
- TGI tangential gradient index
- RGI radial gradient index
- LEI line enhancement index
- AG average gradient
- STD standard deviation of pixel value
- APV average pixel value.
- Figure 8 shows the comparison of ROC curves corresponding to: (1) the ANN with the computer extracted features, (2) the ANN with six selected subjective ratings by radiologists, and (3) the radiologists.
- ANNs trained with subjective ratings by radiologists was better than that by radiologists themselves in distinguishing benign from malignant pulmonary nodules. Similar results were reported in studies on differential diagnosis of breast cancer [22, 23] and also interstitial lung diseases [40]. This may be because radiologists would not use all of the image features, which were obtained in subjective ratings in this study in their differential diagnosis of solitary pulmonary nodules. For example, due to their knowledge and own experience, a limited number of conspicuous features are likely to affect strongly their decision making in some cases, and radiologists generally tend not to consider all of features systematically. On the other hand, ANNs are affected by all of the data consistently and comprehensively. In addition, ANNs are superior to radiologists in merging large amounts of data.
- An ANN has a unique capability to learn specific patterns between input and output data if the ANN is trained by examples repeatedly; however, this capability strongly depends on the quality of the input data. In other words, if input data are selected randomly and have no correlation with output data, the ANN is unlikely to learn any specific patterns between input and output data, resulting in a lower performance.
- images were provided as a guide to radiologists to use the criterion consistently for extracting subjective image features, the ratings are highly subjective, and could be affected strongly by an individual radiologist's knowledge and experience, which may have caused the large variation in the ratings of the radiologists.
- Another limitation of using subjective ratings for input data to train and test the ANN is that the quality of subjective ratings as input data for the ANN considerably depends on the ability of a radiologist to extract or quantify nodule features.
- the performance of the ANN with subjective features extracted by radiology residents were much lower than that of attending radiologists, which indicates that less experienced radiologists could not extract the nodule features sufficiently, and consequently, the ANN could not learn well the specific patterns between input data and output data. Therefore, computer-aided diagnostic schemes that can extract nodule features automatically, objectively, and reproducibly are highly desirable.
- the ANN having input features automatically determined by computer performed better (based on Az) than the average performance of the radiologists. Moreover, the ANN trained with features determined by computer performed better than the ANN trained with subjective features. Although the objective measures were selected initially on the basis of their expected correlation with the subjective features, these objective measures may contain different and/or additional information from the subjective features, which may explain why the objective measures contributed more effectively than the subjective features in distinguishing benign from malignant pulmonary nodules.
- a goal of the inventive computerized classification scheme for pulmonary nodules is to reduce the number of benign nodules sent for further diagnostic evaluation.
- the computerized method indicated a higher performance than the average radiologists (based on Az), even though the nodule outline was provided manually by a radiologist.
- the computerized classification method may provide a useful aid to radiologists in diagnosing/differentiating benign from malignant pulmonary nodules, and therefore, it may be possible to reduce the number of "unnecessary" CT examinations.
- This invention conveniently may be implemented using a conventional general pu ⁇ ose computer or micro-processor programmed according to the teachings of the present invention, as will be apparent to those skilled in the computer art.
- Appropriate software can readily be prepared by programmers of ordinary skill based on the teachings of the present disclosure, as will be apparent to those skilled in the software art.
- FIG. 9 is a schematic illustration of a computer system for the computerized analysis of the likelihood of malignancy in pulmonary nodules.
- a computer 100 implements the method of the present invention, wherein the computer housing 102 houses a motherboard 104 which contains a CPU 106, memory 108 (e.g., DRAM, ROM, EPROM, EEPROM, SRAM, SDRAM, and Flash RAM), and other optional special pu ⁇ ose logic devices (e.g., ASICs) or configurable logic devices (e.g., GAL and reprogrammable FPGA).
- the computer 100 also includes plural input devices, (e.g., a keyboard 122 and mouse 124), and a display card 110 for controlling monitor 120.
- the computer 100 further includes a floppy disk drive 114; other removable media devices (e.g., compact disc 119, tape, and removable magneto-optical media (not shown)); and a hard disk 112, or other fixed, high density media drives, connected using an appropriate device bus (e.g., a SCSI bus, an Enhanced IDE bus, or a Ultra DMA bus). Also connected to the same device bus or another device bus, the computer 100 may additionally include a compact disc reader 118, a compact disc reader/writer unit (not shown) or a compact disc jukebox (not shown). Although compact disc 119 is shown in a CD caddy, the compact disc 119 can be inserted directly into CD- ROM drives which do not require caddies.
- a floppy disk drive 114 other removable media devices (e.g., compact disc 119, tape, and removable magneto-optical media (not shown)); and a hard disk 112, or other fixed, high density media drives, connected using an appropriate device bus (e.g., a
- the system includes at least one computer readable medium.
- Examples of computer readable media are compact discs 119, hard disks 112, floppy disks, tape, magneto-optical disks, PROMs (EPROM, EEPROM, Flash EPROM), DRAM, SRAM, SDRAM, etc.
- the present invention includes software for controlling both the hardware of the computer 100 and for enabling the computer 100 to interact with a human user.
- Such software may include, but is not limited to, device drivers, operating systems and user applications, such as development tools.
- Such computer readable media further includes the computer program product of the present invention for performing the inventive method described above, including steps SI through S7 of Figure 1(a).
- the computer code devices of the present invention can be any inte ⁇ reted or executable code mechanism, including but not limited to scripts, inte ⁇ reters, dynamic link libraries, Java classes, and complete executable programs. Moreover, parts of the processing of the present invention may be distributed for better performance, reliability, and/or cost. For example, an outline or image may be selected on a first computer and sent to a second computer for remote diagnosis.
- the invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art.
- numerous modifications and variations of the present invention are possible in light of the above teachings.
- the outline of the nodules may be extracted using any available automated technique, rather than manually. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
- Metz CE ROC methodology in radiologic imaging. Invest Radiol 1986; 21:720 733.
- Metz CE Herman BA, Shen JH. Maximum-likelihood estimation of receiver operating (ROC) curves from continuously-distributed data. Statistics in Medicine (in press).
- Anastasio MA Yoshida H. Nagel R. Nishikawa RM, Doi K. A genetic algorithm based method for optimizing the performance of a computer-aided diagnosis scheme for detection of clustered microcalcifications in mammograms.
- Ashizawa K MacMahon H. Ishida T. Vyborny CJ, Katsuragawa S.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10816798P | 1998-11-13 | 1998-11-13 | |
| US108167P | 1998-11-13 | ||
| PCT/US1999/025998 WO2000030021A1 (en) | 1998-11-13 | 1999-11-12 | System for detection of malignancy in pulmonary nodules |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1129426A1 true EP1129426A1 (en) | 2001-09-05 |
| EP1129426A4 EP1129426A4 (en) | 2002-08-21 |
Family
ID=22320683
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP99958770A Withdrawn EP1129426A4 (en) | 1998-11-13 | 1999-11-12 | METHOD FOR DETECTING MALIGNITY IN LUNG BUBBLE |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP1129426A4 (en) |
| JP (1) | JP2002530133A (en) |
| AU (1) | AU1606400A (en) |
| WO (1) | WO2000030021A1 (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6898303B2 (en) * | 2000-01-18 | 2005-05-24 | Arch Development Corporation | Method, system and computer readable medium for the two-dimensional and three-dimensional detection of lesions in computed tomography scans |
| JP4393016B2 (en) * | 2000-06-30 | 2010-01-06 | 株式会社日立メディコ | Diagnostic imaging support device |
| JP3642059B2 (en) * | 2002-09-06 | 2005-04-27 | 独立行政法人理化学研究所 | Contour data extraction method and apparatus for biological tomographic image |
| JP2004135868A (en) * | 2002-10-17 | 2004-05-13 | Fuji Photo Film Co Ltd | System for abnormal shadow candidate detection process |
| JP2005323629A (en) * | 2004-05-12 | 2005-11-24 | Ge Medical Systems Global Technology Co Llc | Diagnosis supporting device |
| US20090175531A1 (en) * | 2004-11-19 | 2009-07-09 | Koninklijke Philips Electronics, N.V. | System and method for false positive reduction in computer-aided detection (cad) using a support vector macnine (svm) |
| US7738683B2 (en) | 2005-07-22 | 2010-06-15 | Carestream Health, Inc. | Abnormality detection in medical images |
| US7623694B2 (en) * | 2006-01-31 | 2009-11-24 | Mevis Medical Solutions, Inc. | Method and apparatus for classifying detection inputs in medical images |
| EP1994493A1 (en) * | 2006-03-03 | 2008-11-26 | Koninklijke Philips Electronics N.V. | Identifying set of image characteristics for assessing similarity of images |
| US8923577B2 (en) * | 2006-09-28 | 2014-12-30 | General Electric Company | Method and system for identifying regions in an image |
| EP1947606A1 (en) * | 2007-01-16 | 2008-07-23 | National University Corporation Kobe University | Medical image processing apparatus and medical image processing method |
| US8116553B2 (en) * | 2007-10-03 | 2012-02-14 | Siemens Product Lifecycle Management Software Inc. | Rotation invariant 2D sketch descriptor |
| EP2217141B1 (en) * | 2007-11-13 | 2021-03-31 | Oridion Medical 1987 Ltd. | Medical apparatus |
| JP5527869B2 (en) * | 2008-03-21 | 2014-06-25 | 国立大学法人神戸大学 | Image diagnosis support processing apparatus and image diagnosis support processing program |
| JP6415878B2 (en) * | 2014-07-10 | 2018-10-31 | キヤノンメディカルシステムズ株式会社 | Image processing apparatus, image processing method, and medical image diagnostic apparatus |
| US9865052B2 (en) * | 2016-03-18 | 2018-01-09 | Niramai Health Analytix Pvt Ltd | Contour-based determination of malignant tissue in a thermal image |
| US10346728B2 (en) * | 2017-10-26 | 2019-07-09 | Hitachi, Ltd. | Nodule detection with false positive reduction |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4961425A (en) * | 1987-08-14 | 1990-10-09 | Massachusetts Institute Of Technology | Morphometric analysis of anatomical tomographic data |
| US5003979A (en) * | 1989-02-21 | 1991-04-02 | University Of Virginia | System and method for the noninvasive identification and display of breast lesions and the like |
| US5133020A (en) * | 1989-07-21 | 1992-07-21 | Arch Development Corporation | Automated method and system for the detection and classification of abnormal lesions and parenchymal distortions in digital medical images |
| US5332968A (en) * | 1992-04-21 | 1994-07-26 | University Of South Florida | Magnetic resonance imaging color composites |
| US5319549A (en) * | 1992-11-25 | 1994-06-07 | Arch Development Corporation | Method and system for determining geometric pattern features of interstitial infiltrates in chest images |
| US5426684A (en) * | 1993-11-15 | 1995-06-20 | Eastman Kodak Company | Technique for finding the histogram region of interest for improved tone scale reproduction of digital radiographic images |
| US5881124A (en) * | 1994-03-31 | 1999-03-09 | Arch Development Corporation | Automated method and system for the detection of lesions in medical computed tomographic scans |
| DE69513300T2 (en) * | 1994-08-29 | 2000-03-23 | Torsana A/S, Skodsborg | DETERMINATION PROCEDURE |
| US5790690A (en) * | 1995-04-25 | 1998-08-04 | Arch Development Corporation | Computer-aided method for automated image feature analysis and diagnosis of medical images |
-
1999
- 1999-11-12 EP EP99958770A patent/EP1129426A4/en not_active Withdrawn
- 1999-11-12 AU AU16064/00A patent/AU1606400A/en not_active Abandoned
- 1999-11-12 JP JP2000582958A patent/JP2002530133A/en active Pending
- 1999-11-12 WO PCT/US1999/025998 patent/WO2000030021A1/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| EP1129426A4 (en) | 2002-08-21 |
| JP2002530133A (en) | 2002-09-17 |
| AU1606400A (en) | 2000-06-05 |
| WO2000030021A1 (en) | 2000-05-25 |
| WO2000030021A9 (en) | 2000-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6738499B1 (en) | System for detection of malignancy in pulmonary nodules | |
| Sahiner et al. | Effect of CAD on radiologists' detection of lung nodules on thoracic CT scans: analysis of an observer performance study by nodule size | |
| Xu et al. | Computer-aided classification of interstitial lung diseases via MDCT: 3D adaptive multiple feature method (3D AMFM) | |
| Yilmaz et al. | Computer-aided diagnosis of periapical cyst and keratocystic odontogenic tumor on cone beam computed tomography | |
| Giger et al. | Computer-aided diagnosis | |
| Li | Recent progress in computer-aided diagnosis of lung nodules on thin-section CT | |
| Santos et al. | Automatic detection of small lung nodules in 3D CT data using Gaussian mixture models, Tsallis entropy and SVM | |
| McNitt-Gray et al. | The effects of co-occurrence matrix based texture parameters on the classification of solitary pulmonary nodules imaged on computed tomography | |
| Way et al. | Computer‐aided diagnosis of pulmonary nodules on CT scans: improvement of classification performance with nodule surface features | |
| US6694046B2 (en) | Automated computerized scheme for distinction between benign and malignant solitary pulmonary nodules on chest images | |
| Sutton et al. | Texture measures for automatic classification of pulmonary disease | |
| da Silva Sousa et al. | Methodology for automatic detection of lung nodules in computerized tomography images | |
| Giger et al. | Anniversary paper: history and status of CAD and quantitative image analysis: the role of medical physics and AAPM | |
| Li et al. | Investigation of new psychophysical measures for evaluation of similar images on thoracic computed tomography for distinction between benign and malignant nodules | |
| EP1129426A1 (en) | System for detection of malignancy in pulmonary nodules | |
| Li et al. | Computer-aided diagnosis in thoracic CT | |
| Nishio et al. | Computer-aided diagnosis for lung cancer: usefulness of nodule heterogeneity | |
| Shiraishi et al. | Computer-aided diagnosis for the detection and classification of lung cancers on chest radiographs: ROC analysis of radiologists’ performance | |
| Van Beek et al. | Validation study of machine-learning chest radiograph software in primary and emergency medicine | |
| US20030103663A1 (en) | Computerized scheme for distinguishing between benign and malignant nodules in thoracic computed tomography scans by use of similar images | |
| Pino Peña et al. | Automatic emphysema detection using weakly labeled HRCT lung images | |
| Cunliffe et al. | Lung texture in serial thoracic ct scans: Assessment of change introduced by image registration a | |
| Obert et al. | Quantitative computed tomography applied to interstitial lung diseases | |
| EP3539079A1 (en) | Apparatus for the detection of opacities in x-ray images | |
| Ajmera et al. | Deep-learning-based automatic detection of pulmonary nodules from chest radiographs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20010605 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE Kind code of ref document: A1 Designated state(s): DE FR GB IT NL |
|
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20020704 |
|
| AK | Designated contracting states |
Kind code of ref document: A4 Designated state(s): DE FR GB IT NL |
|
| RIC1 | Information provided on ipc code assigned before grant |
Free format text: 7G 06F 19/00 A, 7G 06K 9/66 B |
|
| 17Q | First examination report despatched |
Effective date: 20021122 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): DE FR GB IT NL |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20040108 |