US20090036789A1 - Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses - Google Patents
Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses Download PDFInfo
- Publication number
- US20090036789A1 US20090036789A1 US12/287,249 US28724908A US2009036789A1 US 20090036789 A1 US20090036789 A1 US 20090036789A1 US 28724908 A US28724908 A US 28724908A US 2009036789 A1 US2009036789 A1 US 2009036789A1
- Authority
- US
- United States
- Prior art keywords
- heart
- sound
- heart sound
- processor
- sounds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/43—Detecting, measuring or recording for evaluating the reproductive systems
- A61B5/4306—Detecting, measuring or recording for evaluating the reproductive systems for evaluating the female reproductive systems, e.g. gynaecological evaluations
- A61B5/4343—Pregnancy and labour monitoring, e.g. for labour onset detection
- A61B5/4362—Assessing foetal parameters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B5/024—Measuring pulse rate or heart rate
- A61B5/02411—Measuring pulse rate or heart rate of foetuses
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/023—Stethoscopes for introduction into the body, e.g. into the oesophagus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/026—Stethoscopes comprising more than one sound collector
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/04—Electric stethoscopes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/22—Source localisation; Inverse modelling
Definitions
- This invention relates generally to the medical arts and more particularly to sensing of heart sound information.
- a multiple gestation is a pregnancy in which a woman carries more than one fetus. Multiple gestations are concerning because women who are expecting more than one baby are at increased risk of certain pregnancy complications, including preterm delivery. Some of the complications associated with multiple gestation can be minimized if they are detected and diagnosed early.
- the embryonic heart starts beating twenty-two days after conception.
- the heart at this stage may be too small to hear.
- the ninth or tenth week after the last menstrual period of the expecting mother one is more likely to be able to hear the heartbeat of the fetus.
- the twelve week the heartbeat can usually be heard consistently by using a Doppler instrument for amplification.
- FPCG fetal phonocardiogram
- the FPCG allows the measurement of the instantaneous fetal heart rate, beat-to-beat differences and duration of systolic and diastolic phases. These measures are sensitive indicators of cardiac function, reflecting fetal well-being. With the record of various critical cardiac activities readily available, some abnormalities of the fetal heart can be detected in the early stages of the pregnancy. A problem arises with the detection of the abnormalities of the fetal heart in the event of a multiple gestation. When more than one fetus is present in a mother's womb, the acoustic transducer (acoustic or electronic stethoscope) captures multiple FPCGs. As one shortcoming, it is difficult to clearly discern the heart sounds from one fetus in the mother's womb from the heart sounds of another fetus in the mother's womb.
- the invention in one implementation encompasses an apparatus.
- the apparatus comprises a heart sound analyzer component that extracts a heart sound of a fetus from heart sound information that comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses.
- the apparatus comprises a plurality of sensor pods of a stethoscope sensor head that are employable to capture a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses that allow extraction of a heart sound of a fetus from the plurality of mixtures of the plurality of heart sounds of the plurality of fetuses.
- Heart sound information is obtained that comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses.
- a heart sound of a fetus extracted from the heart sound information.
- FIG. 1 is a representation of one exemplary implementation of an apparatus that comprises a heart sound analyzer, a sensor array of a plurality of sensors, a plurality of signal paths, and one or more speaker components.
- FIG. 2 is a representation of the heart sound analyzer of the apparatus of FIG. 1 , and illustrates one or more analog to digital converters, one or more data buffer components, one or more software memory components, one or more processor components, one or more digital to analog converters, one or more filters, one or more amplifiers, one or more storage devices, one or more input devices, and one or more output devices.
- FIG. 3 is a representation of a womb of a woman that carries a plurality of fetuses that each contributes a heart sound to heart sound information captured by the plurality of sensors of the apparatus of FIG. 1 .
- FIG. 4 is a representation of an exemplary neural network that extracts two statistically independent outputs from heart sound information captured by the plurality of sensors of the apparatus of FIG. 1 .
- FIG. 5 is a representation of an exemplary interaction between a neural network and a recursive parameter adjustment algorithm of the heart sound analyzer of the apparatus of FIG. 1 .
- FIG. 6 is a representation of one exemplary plot of two fetal phonocardiograms that comprise heart sounds of two fetal hearts.
- FIG. 7 is a representation of another exemplary plot of heart sound information representing the output of two sensors of the plurality of sensors of the apparatus of FIG. 1 .
- Two fetal heart sounds are delayed by propagation delays between the fetal hearts and the plurality of sensors and then mixed by each of the plurality of sensors.
- FIG. 8 is a representation of another exemplary plot of two fetal phonocardiograms extracted from heart sound information by the heart sound analyzer of the apparatus of FIG. 1 .
- an apparatus 10 Q in one example comprises a heart sound analyzer 102 , a sensor array 103 of a plurality of sensors 104 , 106 , 108 , and 110 , a plurality of signal paths 112 , 114 , 116 , and 118 , and one or more speaker components 120 .
- the sensors 104 , 106 , 108 , and 110 in one example obtain heart sound information 122 from a plurality of fetal hearts.
- the heart sound information 122 comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses.
- the sensors 104 , 106 , 108 , and 110 each capture fetal phonocardiograms (“FPCGs”) from the hearts of the plurality of fetuses within a womb of a woman.
- the heart sound information 122 comprises mixtures of heart sounds from the plurality of fetuses.
- the sensors 104 , 106 , 108 , and 110 pass the heart sound information 122 through the signal paths 112 , 114 , 116 , and 118 to the heart sound analyzer 102 .
- the heart sound analyzer 102 extracts a heart sound 124 of a fetus from the heart sound information 122 for aural examination by a doctor.
- the heart sound 124 represents a heartbeat of a single fetal heart substantially without interference from heartbeats of the other fetal hearts within the womb.
- the heart sound analyzer 102 separates the heart sound 124 from one or more other sounds of the heart sound information 122 .
- the heart sound analyzer 102 in one example comprises a fetal phonocardiogram analyzer.
- the plurality of fetuses may comprise twins, triplets, quadruplets, quintuplets, or more.
- the heart sound information 122 may comprise a mixture of two, three, four, five, or more fetal hearts.
- the apparatus 100 comprises a number of the plurality of sensors 104 , 106 , 108 , and 110 at least equal to a number of the plurality of fetuses. In one example, the apparatus 100 comprises a number of the plurality of sensors 104 , 106 , 108 , and 110 greater than a number of the plurality of fetuses.
- the plurality of fetuses may comprise two fetuses and the apparatus 100 may comprise three sensors to allow separation of background noise, or the like, from the output of the heart sound 124 of one of the plurality of fetuses.
- the sensors in one example comprise microphones. The microphones capture the heart sound information 122 .
- the heart sound analyzer 102 comprises one or more analog to digital converters 204 , one or more data buffer components 206 and 212 , one or more software memory components 208 , one or more processor components 210 , one or more digital to analog converters 214 , one or more filters 216 , one or more amplifiers 218 , one or more storage devices 220 , one or more input devices 222 , and one or more output devices 224 .
- the heart sound analyzer 102 Upon receipt of the heart sound information 122 from the sensor array 103 , the heart sound analyzer 102 processes the heart sound information 122 and in one example outputs the heart sound 124 .
- the processor component 210 of the heart sound analyzer 102 extracts heartbeats of one or more of the plurality of fetuses from the heart sound information 122 .
- the heart sound 124 comprises a heartbeat of a first fetus of the plurality of fetuses within the womb.
- the heart sound information 122 comprises a plurality of mixtures of a first heartbeat of a first fetus and a second heartbeat of a second fetus.
- the heart sound analyzer 102 employs a blind source separation algorithm that accounts for propagation delays of the heart sound information 122 to create statistically independent outputs of one or more of the first heartbeat and the second heartbeat.
- the heart sound analyzer 102 in one example employs an independent component analysis procedure to extract the heart sound 124 from the heart sound information 122 .
- the analog to digital converter 204 in one example obtains the heart sound information 122 from the sensor array 103 .
- the analog to digital converter 204 in one example digitizes the heart sound information 122 .
- the processor component 210 employs the analog to digital converter 204 to digitize the heart sound information 122 .
- the analog to digital converter 204 in one example outputs an M ⁇ K matrix of data of the heart sound information 122 to the data buffer component 206 , where, for example, M is the number of sensors (e.g., the sensors 104 , 106 , 108 , and 110 ) in the sensor array 103 and K is the number of times the analog to digital converter 204 samples the heart sound information 122 .
- the data buffer component 206 in one example comprises M ⁇ K point double buffered data memory.
- the data buffer component 206 in one example provides the M ⁇ K matrix of data to the processor component 210 .
- the data buffer component 206 in one example comprises a demultiplexer, first and second data buffers, and a multiplexer.
- the processor component 210 in one example controls the demultiplexer to steer the output of the analog to digital converter 204 to the first data buffer with an M ⁇ K matrix of data. While the first data buffer is filling with data, the processor component 210 in one example controls the multiplexer to steer data from the second data buffer to the processor component 210 until the processor component 210 has received an M ⁇ K matrix of data.
- the processor component 210 processes the M ⁇ K matrix of data with software stored in the software memory component 208 .
- the processor component 210 controls the demultiplexer to steer data to the second data buffer with an M ⁇ K matrix of data. While the second data buffer is filling with data, the processor component 210 in one example controls the multiplexer to steer data from the first data buffer to the processor component 210 until the processor component 210 has received an M ⁇ K matrix of data.
- the processor component 210 again employs the software stored in the software memory component 208 to process the M ⁇ K matrix of data.
- the software memory component 208 in one example stores software for use by the processor component 210 .
- the processor component 210 employs the software to extract the heart sound 124 from the heart sound information 122 .
- the software memory component 208 in one example comprises an instance of the recordable data storage medium 146 .
- the software memory component 208 in one example stores a blind source separation algorithm that accounts for propagation delays within the heart sound information 122 .
- the processor component 210 employs the blind source separation algorithm to extract the heart sound 124 from the heart sound information 122 .
- the processor component 210 After extraction of the heart sound 124 from the heart sound information 122 , the processor component 210 stores the heart sound 124 .
- the processor component 210 may store the heart sound 124 in the storage device 220 .
- the processor component 210 may then access the heart sound 124 upon request from a user of the heart sound analyzer 102 .
- the user may employ the input device 222 to cause the processor 210 to output the heart sound 124 to the output device 224 and/or the speaker component 120 .
- the input device 222 in one example comprise one or more of a button, a dial, a mouse, a keyboard, and/or a touch-screen.
- the output device 224 in one example comprise a liquid crystal display (“LCD”).
- the user in one example chooses with the input device 222 to listen to the heart sound 124 with the speaker component 120 . In another example, the user chooses with the input device 222 to output the heart sound 124 to the output device 224 .
- the user may also choose to filter, amplify, and/or shift a spectral content of the heart sound 124 from a first frequency range to a second frequency range with the processor component 210 .
- the processor component 210 employs digital filtering software to filter out one or more frequency ranges of the heart sound 124 .
- the processor component 210 amplifies one or more regions of the heart sound 124 .
- the processor component 210 may shift the spectral content of the heart sound 124 from a first frequency range to a second frequency range. For example, the user may hear better in the second frequency range than in the first frequency range.
- the data buffer component 212 obtains data from the processor component 210 . In one example, the data buffer component 212 obtains the heart sound 124 from the processor component 210 . In another example, the data buffer component 212 obtains the heart sound 124 which has been spectrally modified, spectrally shifted, and/or amplified.
- the data buffer component 212 in one example comprises K point double buffered data memory.
- the digital to analog converter 214 in one example converts a digital representation of the heart sound 124 into an analog representation of the heart sound 124 .
- the digital to analog converter 214 in one example outputs the heart sound 124 to one or more of the speaker component 120 , the filter 216 , and/or the amplifier 218 .
- the filter 216 in one example filters one or more frequency ranges of the analog representation of the heart sound 124 .
- the filter 216 in one example comprises one or more low pass filters.
- the amplifier 218 in one example amplifies an output of the filter 216 to drive the speaker component 120 .
- the user may employ one or more of the speaker component 120 and/or the output device 224 to listen to and/or view the heart sound 124 and/or a representation of the heart sound 124 .
- the user may employ the speaker component 120 and/or the output device 224 for examination of the heart sound 124 .
- the user may employ the heart sound analyzer 102 to automatically diagnose one or more fetal heart dysfunctions.
- the processor component 210 compares one or more features (e.g., signatures) of the heart sound 124 to a normal range of the features (e.g., signatures) of the heart sound 124 . If the heart sound 124 is outside of the normal range, then the heart sound 124 may indicate one or more dysfunctions.
- the heart sound 124 in one example is a mixture of a plurality of discrete heart sounds from a plurality of corresponding distinct heart sound sources (e.g., a heart valve) of a single fetal heart.
- the heart sound analyzer 102 may extract from the heart sound 124 one or more discrete heart sounds of the corresponding distinct heart sound sources, as described in “EXTRACTION OF ONE OR MORE DISCRETE HEART SOUNDS FROM HEART SOUND INFORMATION,” by Priemer, co-filed herewith.
- the heart sound 124 may comprise a first discrete heart sound from a first distinct sound source of the single fetal heart.
- the heart sound 124 may also comprise a second discrete heart sound from a second distinct sound source of the single fetal heart.
- the first and second discrete heart sounds in one example occur contemporaneously in the heart sound 124 .
- the heart sound analyzer 102 in one example creates statistically independent outputs of one or more of the first discrete heart sound and the second discrete heart sound to allow aural examination of the individual first and second discrete heart sounds by a doctor.
- a womb 302 of a woman may carry a plurality of fetuses 304 and 306 .
- Each of the fetuses 304 and 306 contribute heart sounds to the heart sound information 122 captured by the sensors 104 , 106 , 108 , and 110 .
- the sensors 104 , 106 , 108 , and 110 in one example are organized into a plurality of sensor pods 308 and 310 .
- each of the sensor pods 308 and 310 comprise a single sensor or microphone.
- the sensor pod 308 comprises a plurality of sensors (e.g., the sensors 104 and 106 ) and the sensor pod 310 comprises a plurality of sensors (e.g., the sensors 108 and 110 ).
- the sensor pods 308 and 310 are independently movable over an abdomen 312 of the woman to capture the heart sound information 122 of the fetuses 304 and 306 within the womb 302 .
- a doctor may move the sensor pod 308 over the abdomen 312 to a location that is near the fetus 304 and the doctor may move the sensor pod 310 over the abdomen 312 to a location that is near the fetus 306 .
- the heart sound information 122 comprises a mixture of first heart sounds from a heart 314 of the fetus 304 and second heart sounds from a heart 316 of the fetus 306 .
- the first heart sounds from the fetus 304 experience a propagation delay (d 22 ) 318 traveling to the sensor pod 308 and a propagation delay (d 12 ) 320 traveling to the sensor pod 310 .
- the second heart sounds from the fetus 306 experience a propagation delay (d 21 ) 322 traveling to the sensor pod 308 and a propagation delay (d 11 ) 324 traveling to the sensor pod 310 .
- the blind source separation algorithm accounts for the propagation delays (d 22 , d 12 , d 21 , and d 11 ) 318 , 320 , 322 , and 324 of the first and second heart sounds from the hearts 314 and 316 .
- a neural network 402 illustrates an exemplary extraction of two statistically independent outputs from the heart sound information 122 captured by two sensors (e.g., the sensors 104 and 106 ).
- the processor component 210 passes the heart sound information 122 through a plurality of external nodes of the neural network 402 in number at least equal to the number of the plurality of fetuses 304 and 306 .
- the processor component 210 passes the heart sound information 122 through a plurality of internal nodes of the neural network 402 equal to the number of external nodes to determine one or more weights and one or more delays of each of the heart sounds from the plurality of fetuses 304 and 306 .
- the neural network 406 outputs an M ⁇ K matrix of data that represents the heart sounds of the plurality of fetuses 304 and 306 .
- the heart sounds of the plurality of fetuses 304 and 306 in one example are statistically independent.
- the heart sound information 122 comprises a plurality of composite heart sounds.
- the plurality of composite heart sounds comprise a composite heart sound signal (x 1 ) 404 captured by the sensor 104 and a composite heart sound signal (x 2 ) 406 captured by the sensor 104 .
- the outputs of the sensors 104 and 106 are sampled at discrete time points t.
- the sampling rate is 1/T samples/sec, and n is called the discrete time index.
- the composite heart sound signals (x 1 and x 2 ) 404 and 406 in one example comprise delayed mixtures of fetal phonocardiogram (s 1 ) produced by the fetus 306 and fetal phonocardiogram (s 2 ) produced by the fetus 304 .
- the composite heart sound signals (x 1 and x 2 ) 404 and 406 in one example are modeled by:
- x 1 ( t ) a 11 s 1 ( t ⁇ d 1 )+ a 12 s 2 ( t ⁇ d 12 )
- x 2 ( t ) a 21 s 1 ( t ⁇ d 21 )+ a 22 s 2 ( t ⁇ d 22 )
- d 22 , d 12 , d 21 , and d 11 represent the propagation delays 318 , 320 , 322 , and 324 of the first and second heart sounds. Also, where all, a 12 , a 21 , and a 22 represent attenuations of the first and second heart sounds due to signal strength losses traveling through the abdomen 312 of the woman to the sensors (e.g., the sensors 104 and 106 ).
- the neural network 402 serves to separate the composite heart sound signals (x 1 and x 2 ) 404 and 406 to obtain estimates (u 1 and u 2 ) 408 and 410 of the fetal phonocardiograms s 1 and s 2 .
- the neural network computes:
- u 1 ( t ) w 11 x 1 ( t )+ w 12 u 2 ( t ⁇ ( b 12 ))+ w 01
- u 2 ( t ) w 22 x 2 ( t )+ w 21 u 1 ( t ⁇ ( b 21 ))+ w 02
- b 12 and b 21 represent delay differences 414 and 412 between the propagation delays 318 , 320 , 322 , and 324 . Also, where w 01 , w 11 , w 12 , w 02 , w 22 and w 21 represent weights 416 , 420 , 424 , 418 , 422 , and 426 of the neural network 402 .
- the blocks 428 and 430 that convert the estimates (u 1 and u 2 ) 408 and 410 to signals (y 1 and y 2 ) 432 and 434 represent nonlinearities described by the equations below.
- a logistic function relates the estimate (u 1 ) 408 to the signal (y 1 ) 432 and the estimate (u 2 ) 410 to the signal (y 2 ) 434 .
- a monotonically increasing nonlinear function converts the estimate (u 1 ) 408 to the signal (y 1 ) 432 and the estimate (u 2 ) 410 to the signal (y 2 ) 434 .
- the parameters e.g., the weights (w 01 , w 11 , w 12 , w 02 , w 22 and w 21 ) 416 , 420 , 424 , 418 , 422 , and 426 , and the delay differences (b 12 and b 21 ) 414 and 412 ) of the neural network 402 are calculated to make the signals (y 1 and y 2 ) 432 and 434 statistically independent. Then, the estimates (u 1 and u 2 ) 408 and 410 must also be statistically independent. If the conditions below are achieved:
- the estimate (u 1 ) 408 becomes proportional to the fetal phonocardiogram (s 1 ) and the estimate (u 2 ) 410 becomes proportional to the fetal phonocardiogram (s 2 ), delayed by the propagation delays (d 11 and d 22 ) 324 and 318 , respectively, which means that the estimates (u 1 and u 2 ) 408 and 410 are statistically independent, resulting in:
- the recursive parameter adjustment algorithm 502 to estimate weights and delays of the neural network 402 is based on the gradients given by:
- the formulas above give the gradients of entropy of the signals H(y 1 , y 2 ) with respect to each of the parameters of the neural network 402 .
- a parameter of the neural network 402 such as the weight (w 11 ) 420 .
- the gradient of H with respect to the weight (w 11 ) 420 is denoted by ⁇ w 11 .
- ⁇ w 11 For each input sample x 1 (t) and x 2 (t), y 1 (t) and y 2 (t) and u 1 (t) and u 2 (t) can be calculated and then ⁇ w 11 (t) can also be calculated. ⁇ w 11 can be calculated for many (e.g., K) input samples, and then the resulting average of ⁇ w 11 can be calculated. Then, the average of ⁇ w 11 , denoted by ⁇ w 11 (K), is used to update the value of the weight (w 11 ) 420 with:
- h a small number, is called the learning rate, that is selected by trial and error.
- Each of the other weights (w 01 , w 11 , w 12 , w 02 , w 22 and w 21 ) 416 , 420 , 424 , 418 , 422 , and 426 , and the delay differences (b 12 and b 21 ) 414 and 412 are updated analogously.
- the blind source separation algorithm that accounts for the propagation delays of the heart sound information 122 comprises a number of steps.
- the first step is for the heart sound analyzer 102 to collect a fixed number (e.g., K) of incoming mixture samples in a single frame.
- the second step is for the heart sound analyzer 102 to calculate the updates to be made to the weights (w 01 , w 11 , w 12 , w 02 , w 22 and w 21 ) 416 , 420 , 424 , 418 , 422 , and 426 , and propagation delay differences (b 12 and b 21 ) 414 and 412 by iterating over the frame once.
- the third step is for the heart sound analyzer 102 to repeat the first and second steps until a predetermined number of iterations over a frame have been completed, or the updates to weights (w 01 , w 11 , w 12 , w 02 , w 22 and w 21 ) 416 , 420 , 424 , 418 , 422 , and 426 , and propagation delay differences (b 12 and b 21 ) 414 and 412 have become smaller than a predetermined threshold.
- the fourth step is for the heart sound analyzer 102 to input the next frame, which comprises new incoming data, and discard the last frame.
- the fifth step is for the heart sound analyzer 102 to repeat the first, second, third, and fourth steps until the weights (w 01 , w 11 , w 12 , w 02 , w 22 and w 21 ) 416 , 420 , 424 , 418 , 422 , and 426 , and propagation delay differences (b 12 and b 21 ) 414 and 412 have converged to constants.
- the neural network 402 receives the composite heart sound signals (x 1 and x 2 ) 404 and 406 as inputs.
- a recursive parameter adjustment algorithm 502 also receives the heart sound signals (x 1 and x 2 ) 404 and 406 as inputs.
- the neural network 402 produces the estimates (u 1 and u 2 ) 408 and 410 and the signals (y 1 and y 2 ) 432 and 434 .
- the recursive parameter adjustment algorithm 502 receives the estimates (u 1 and u 2 ) 408 and 410 and the signals (y 1 and y 2 ) 432 and 434 as inputs.
- the recursive parameter adjustment algorithm 502 serves to determine the parameters (e.g., the weights and delay differences) of the neural network 402 .
- fetal phonocardiograms 602 and 604 illustrate heart sounds of two fetal hearts.
- FIG. 7 depicts heart sound information 702 and 704 comprised of mixtures of heart sounds of the two fetal hearts delayed by propagation delays between the fetal hearts and the sensors.
- Fetal phonocardiograms 802 and 804 illustrate a separation of the heart sounds of the two fetal hearts from the mixed phonocardiograms 702 and 704 .
- the heart sound information 122 comprises the two phonocardiogram mixtures 702 and 704 .
- the heart sound analyzer 102 extracts the heart sound of each of the two fetuses into statistically independent outputs.
- the apparatus 100 in one example comprises a plurality of components such as one or more of electronic components, hardware components, and computer software components. A number of such components can be combined or divided in the apparatus 100 .
- An exemplary component of the apparatus 100 employs and/or comprises a set and/or series of computer instructions written in or implemented with any of a number of programming languages, as will be appreciated by those skilled in the art.
- the apparatus 100 in one example employs one or more computer-readable signal-bearing media.
- a computer-readable signal-bearing medium for the apparatus 100 comprise the recordable data storage medium 146 of the heart sound analyzer 102 .
- the computer-readable signal-bearing medium for the apparatus 100 comprises one or more of a magnetic, electrical, optical, biological, and atomic data storage medium.
- the computer-readable signal-bearing medium comprises a modulated carrier signal transmitted over a network comprising or coupled with the apparatus 100 , for instance, one or more of a telephone network, a local area network (“LAN”), the internet, and a wireless network.
- LAN local area network
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- General Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Gynecology & Obstetrics (AREA)
- Pregnancy & Childbirth (AREA)
- Cardiology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Physiology (AREA)
- Pediatric Medicine (AREA)
- Reproductive Health (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
A heart sound analyzer component of an apparatus in one example extracts a heart sound of a fetus from heart sound information that comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses.
Description
- This application claims the priority of U.S. provisional Patent Application Ser. No. 60/488,311 (by Roland Priemer, filed Jul. 18, 2003, and entitled “CARDIAC SOUND SEPARATOR AND STETHOSCOPE”).
- This application claims the priority of U.S. provisional Patent Application Ser. No. 60/537,941 (by Roland Priemer, filed Jan. 21, 2004, and entitled “EXTRACTION OF ONE OR MORE DISCRETE HEART SOUNDS FROM HEART SOUND INFORMATION”).
- This application contains subject matter that is related to the subject matter of the following applications, which are assigned to the same assignee as this application. The below-listed applications are hereby incorporated herein by reference in their entireties.
- “EXTRACTION OF ONE OR MORE DISCRETE HEART SOUNDS FROM HEART SOUND INFORMATION,” by Roland Priemer, co-filed herewith.
- “IDENTIFICATION OF ONE OR MORE DISTINCT HEART SOUND SOURCES THAT PRODUCE ONE OR MORE DISCRETE HEART SOUNDS,” by Roland Priemer, co-filed herewith.
- “HEART SOUND ANALYZER COMPONENT THAT EXTRACTS HEART SOUND OF FETUS FROM HEART SOUND INFORMATION THAT COMPRISES PLURALITY OF MIXTURES OF PLURALITY OF HEART SOUNDS OF PLURALITY OF FETUSES,” by Roland Priemer, co-filed herewith.
- This invention relates generally to the medical arts and more particularly to sensing of heart sound information.
- A multiple gestation is a pregnancy in which a woman carries more than one fetus. Multiple gestations are concerning because women who are expecting more than one baby are at increased risk of certain pregnancy complications, including preterm delivery. Some of the complications associated with multiple gestation can be minimized if they are detected and diagnosed early.
- The embryonic heart starts beating twenty-two days after conception. The heart at this stage may be too small to hear. By the ninth or tenth week after the last menstrual period of the expecting mother, one is more likely to be able to hear the heartbeat of the fetus. By the twelve week, the heartbeat can usually be heard consistently by using a Doppler instrument for amplification.
- Although the human ear is unequalled in detecting sounds over a particular frequency range, the spectrum occupied by fetal heart sounds is on the threshold of audibility. This aural processing has always caused problems relating to degree and accuracy of fetal auscultation. Electronically processing the fetal phonocardiogram (“FPCG”) presents a way of avoiding these problems. The greater low frequency sensitivity of the phonocardiographic transducer captures all the acoustic information generated by the fetal heart. Then, additional visual examination of the FPCG provides an effective way of determining temporal measures of fetal cardiac function.
- The FPCG allows the measurement of the instantaneous fetal heart rate, beat-to-beat differences and duration of systolic and diastolic phases. These measures are sensitive indicators of cardiac function, reflecting fetal well-being. With the record of various critical cardiac activities readily available, some abnormalities of the fetal heart can be detected in the early stages of the pregnancy. A problem arises with the detection of the abnormalities of the fetal heart in the event of a multiple gestation. When more than one fetus is present in a mother's womb, the acoustic transducer (acoustic or electronic stethoscope) captures multiple FPCGs. As one shortcoming, it is difficult to clearly discern the heart sounds from one fetus in the mother's womb from the heart sounds of another fetus in the mother's womb.
- Thus, a need exists for a capability to discern a heart sound of one fetus from the heart sound of another fetus.
- The invention in one implementation encompasses an apparatus. The apparatus comprises a heart sound analyzer component that extracts a heart sound of a fetus from heart sound information that comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses.
- Another implementation of the invention encompasses an apparatus. The apparatus comprises a plurality of sensor pods of a stethoscope sensor head that are employable to capture a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses that allow extraction of a heart sound of a fetus from the plurality of mixtures of the plurality of heart sounds of the plurality of fetuses.
- Yet another implementation of the invention encompasses a method. Heart sound information is obtained that comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses. A heart sound of a fetus extracted from the heart sound information.
- Features of exemplary implementations of the invention will become apparent from the description, the claims, and the accompanying drawings in which:
-
FIG. 1 is a representation of one exemplary implementation of an apparatus that comprises a heart sound analyzer, a sensor array of a plurality of sensors, a plurality of signal paths, and one or more speaker components. -
FIG. 2 is a representation of the heart sound analyzer of the apparatus ofFIG. 1 , and illustrates one or more analog to digital converters, one or more data buffer components, one or more software memory components, one or more processor components, one or more digital to analog converters, one or more filters, one or more amplifiers, one or more storage devices, one or more input devices, and one or more output devices. -
FIG. 3 is a representation of a womb of a woman that carries a plurality of fetuses that each contributes a heart sound to heart sound information captured by the plurality of sensors of the apparatus ofFIG. 1 . -
FIG. 4 is a representation of an exemplary neural network that extracts two statistically independent outputs from heart sound information captured by the plurality of sensors of the apparatus ofFIG. 1 . -
FIG. 5 is a representation of an exemplary interaction between a neural network and a recursive parameter adjustment algorithm of the heart sound analyzer of the apparatus ofFIG. 1 . -
FIG. 6 is a representation of one exemplary plot of two fetal phonocardiograms that comprise heart sounds of two fetal hearts. -
FIG. 7 is a representation of another exemplary plot of heart sound information representing the output of two sensors of the plurality of sensors of the apparatus ofFIG. 1 . Two fetal heart sounds are delayed by propagation delays between the fetal hearts and the plurality of sensors and then mixed by each of the plurality of sensors. -
FIG. 8 is a representation of another exemplary plot of two fetal phonocardiograms extracted from heart sound information by the heart sound analyzer of the apparatus ofFIG. 1 . - Turning to
FIG. 1 , an apparatus 10Q in one example comprises aheart sound analyzer 102, asensor array 103 of a plurality of 104, 106, 108, and 110, a plurality ofsensors 112, 114, 116, and 118, and one orsignal paths more speaker components 120. The 104, 106, 108, and 110 in one example obtainsensors heart sound information 122 from a plurality of fetal hearts. Theheart sound information 122 comprises a plurality of mixtures of a plurality of heart sounds of a plurality of fetuses. For example, the 104, 106, 108, and 110 each capture fetal phonocardiograms (“FPCGs”) from the hearts of the plurality of fetuses within a womb of a woman. Thesensors heart sound information 122 comprises mixtures of heart sounds from the plurality of fetuses. The 104, 106, 108, and 110 pass thesensors heart sound information 122 through the 112, 114, 116, and 118 to thesignal paths heart sound analyzer 102. Theheart sound analyzer 102 extracts aheart sound 124 of a fetus from theheart sound information 122 for aural examination by a doctor. For example, theheart sound 124 represents a heartbeat of a single fetal heart substantially without interference from heartbeats of the other fetal hearts within the womb. Theheart sound analyzer 102 separates theheart sound 124 from one or more other sounds of theheart sound information 122. Theheart sound analyzer 102 in one example comprises a fetal phonocardiogram analyzer. - The plurality of fetuses may comprise twins, triplets, quadruplets, quintuplets, or more. For example, the
heart sound information 122 may comprise a mixture of two, three, four, five, or more fetal hearts. To extract theheart sound 124 associated with a single fetal heart, theapparatus 100 comprises a number of the plurality of 104, 106, 108, and 110 at least equal to a number of the plurality of fetuses. In one example, thesensors apparatus 100 comprises a number of the plurality of 104, 106, 108, and 110 greater than a number of the plurality of fetuses. For example, the plurality of fetuses may comprise two fetuses and thesensors apparatus 100 may comprise three sensors to allow separation of background noise, or the like, from the output of theheart sound 124 of one of the plurality of fetuses. The sensors in one example comprise microphones. The microphones capture the heartsound information 122. - Referring to
FIGS. 1-2 , theheart sound analyzer 102 comprises one or more analog todigital converters 204, one or more 206 and 212, one or moredata buffer components software memory components 208, one ormore processor components 210, one or more digital toanalog converters 214, one ormore filters 216, one ormore amplifiers 218, one ormore storage devices 220, one ormore input devices 222, and one ormore output devices 224. Upon receipt of the heartsound information 122 from thesensor array 103, theheart sound analyzer 102 processes the heartsound information 122 and in one example outputs theheart sound 124. - The
processor component 210 of theheart sound analyzer 102 extracts heartbeats of one or more of the plurality of fetuses from the heartsound information 122. For example, theheart sound 124 comprises a heartbeat of a first fetus of the plurality of fetuses within the womb. In one example, the heartsound information 122 comprises a plurality of mixtures of a first heartbeat of a first fetus and a second heartbeat of a second fetus. Theheart sound analyzer 102 employs a blind source separation algorithm that accounts for propagation delays of the heartsound information 122 to create statistically independent outputs of one or more of the first heartbeat and the second heartbeat. Theheart sound analyzer 102 in one example employs an independent component analysis procedure to extract theheart sound 124 from the heartsound information 122. - The analog to
digital converter 204 in one example obtains the heartsound information 122 from thesensor array 103. The analog todigital converter 204 in one example digitizes the heartsound information 122. For example, theprocessor component 210 employs the analog todigital converter 204 to digitize the heartsound information 122. The analog todigital converter 204 in one example outputs an M×K matrix of data of the heartsound information 122 to thedata buffer component 206, where, for example, M is the number of sensors (e.g., the 104, 106, 108, and 110) in thesensors sensor array 103 and K is the number of times the analog todigital converter 204 samples the heartsound information 122. Thedata buffer component 206 in one example comprises M×K point double buffered data memory. - The
data buffer component 206 in one example provides the M×K matrix of data to theprocessor component 210. Thedata buffer component 206 in one example comprises a demultiplexer, first and second data buffers, and a multiplexer. Theprocessor component 210 in one example controls the demultiplexer to steer the output of the analog todigital converter 204 to the first data buffer with an M×K matrix of data. While the first data buffer is filling with data, theprocessor component 210 in one example controls the multiplexer to steer data from the second data buffer to theprocessor component 210 until theprocessor component 210 has received an M×K matrix of data. Theprocessor component 210 processes the M×K matrix of data with software stored in thesoftware memory component 208. - After the
processor 210 has completed processing the M×K matrix of data and the first data buffer has filled with data, theprocessor component 210 in one example controls the demultiplexer to steer data to the second data buffer with an M×K matrix of data. While the second data buffer is filling with data, theprocessor component 210 in one example controls the multiplexer to steer data from the first data buffer to theprocessor component 210 until theprocessor component 210 has received an M×K matrix of data. Theprocessor component 210 again employs the software stored in thesoftware memory component 208 to process the M×K matrix of data. By continuously reversing the roles of the first and second data buffers, theheart sound analyzer 102 can work in real time. - The
software memory component 208 in one example stores software for use by theprocessor component 210. Theprocessor component 210 employs the software to extract theheart sound 124 from the heartsound information 122. Thesoftware memory component 208 in one example comprises an instance of the recordabledata storage medium 146. Thesoftware memory component 208 in one example stores a blind source separation algorithm that accounts for propagation delays within the heartsound information 122. Theprocessor component 210 employs the blind source separation algorithm to extract theheart sound 124 from the heartsound information 122. - After extraction of the
heart sound 124 from the heartsound information 122, theprocessor component 210 stores theheart sound 124. For example, theprocessor component 210 may store theheart sound 124 in thestorage device 220. Theprocessor component 210 may then access theheart sound 124 upon request from a user of theheart sound analyzer 102. For example, the user may employ theinput device 222 to cause theprocessor 210 to output theheart sound 124 to theoutput device 224 and/or thespeaker component 120. Theinput device 222 in one example comprise one or more of a button, a dial, a mouse, a keyboard, and/or a touch-screen. Theoutput device 224 in one example comprise a liquid crystal display (“LCD”). - The user in one example chooses with the
input device 222 to listen to theheart sound 124 with thespeaker component 120. In another example, the user chooses with theinput device 222 to output theheart sound 124 to theoutput device 224. The user may also choose to filter, amplify, and/or shift a spectral content of theheart sound 124 from a first frequency range to a second frequency range with theprocessor component 210. In one example, theprocessor component 210 employs digital filtering software to filter out one or more frequency ranges of theheart sound 124. In another example, theprocessor component 210 amplifies one or more regions of theheart sound 124. In still another example, theprocessor component 210 may shift the spectral content of theheart sound 124 from a first frequency range to a second frequency range. For example, the user may hear better in the second frequency range than in the first frequency range. - The
data buffer component 212 obtains data from theprocessor component 210. In one example, thedata buffer component 212 obtains theheart sound 124 from theprocessor component 210. In another example, thedata buffer component 212 obtains theheart sound 124 which has been spectrally modified, spectrally shifted, and/or amplified. Thedata buffer component 212 in one example comprises K point double buffered data memory. - The digital to
analog converter 214 in one example converts a digital representation of theheart sound 124 into an analog representation of theheart sound 124. The digital toanalog converter 214 in one example outputs theheart sound 124 to one or more of thespeaker component 120, thefilter 216, and/or theamplifier 218. Thefilter 216 in one example filters one or more frequency ranges of the analog representation of theheart sound 124. Thefilter 216 in one example comprises one or more low pass filters. Theamplifier 218 in one example amplifies an output of thefilter 216 to drive thespeaker component 120. - The user may employ one or more of the
speaker component 120 and/or theoutput device 224 to listen to and/or view theheart sound 124 and/or a representation of theheart sound 124. The user may employ thespeaker component 120 and/or theoutput device 224 for examination of theheart sound 124. The user may employ theheart sound analyzer 102 to automatically diagnose one or more fetal heart dysfunctions. For example, theprocessor component 210 compares one or more features (e.g., signatures) of theheart sound 124 to a normal range of the features (e.g., signatures) of theheart sound 124. If theheart sound 124 is outside of the normal range, then theheart sound 124 may indicate one or more dysfunctions. - The
heart sound 124 in one example is a mixture of a plurality of discrete heart sounds from a plurality of corresponding distinct heart sound sources (e.g., a heart valve) of a single fetal heart. Theheart sound analyzer 102 may extract from theheart sound 124 one or more discrete heart sounds of the corresponding distinct heart sound sources, as described in “EXTRACTION OF ONE OR MORE DISCRETE HEART SOUNDS FROM HEART SOUND INFORMATION,” by Priemer, co-filed herewith. For example, theheart sound 124 may comprise a first discrete heart sound from a first distinct sound source of the single fetal heart. Theheart sound 124 may also comprise a second discrete heart sound from a second distinct sound source of the single fetal heart. The first and second discrete heart sounds in one example occur contemporaneously in theheart sound 124. Theheart sound analyzer 102 in one example creates statistically independent outputs of one or more of the first discrete heart sound and the second discrete heart sound to allow aural examination of the individual first and second discrete heart sounds by a doctor. - Referring to
FIGS. 1 and 3 , awomb 302 of a woman may carry a plurality of 304 and 306. Each of thefetuses 304 and 306 contribute heart sounds to the heartfetuses sound information 122 captured by the 104, 106, 108, and 110. Thesensors 104, 106, 108, and 110 in one example are organized into a plurality ofsensors 308 and 310. In one example, each of thesensor pods 308 and 310 comprise a single sensor or microphone. In another example, thesensor pods sensor pod 308 comprises a plurality of sensors (e.g., thesensors 104 and 106) and thesensor pod 310 comprises a plurality of sensors (e.g., thesensors 108 and 110). - The
308 and 310 are independently movable over ansensor pods abdomen 312 of the woman to capture the heartsound information 122 of the 304 and 306 within thefetuses womb 302. For example, a doctor may move thesensor pod 308 over the abdomen 312 to a location that is near thefetus 304 and the doctor may move thesensor pod 310 over the abdomen 312 to a location that is near thefetus 306. - The heart
sound information 122 comprises a mixture of first heart sounds from aheart 314 of thefetus 304 and second heart sounds from aheart 316 of thefetus 306. The first heart sounds from thefetus 304 experience a propagation delay (d22) 318 traveling to thesensor pod 308 and a propagation delay (d12) 320 traveling to thesensor pod 310. The second heart sounds from thefetus 306 experience a propagation delay (d21) 322 traveling to thesensor pod 308 and a propagation delay (d11) 324 traveling to thesensor pod 310. To extract theheart sound 124 from the heartsound information 122, the blind source separation algorithm accounts for the propagation delays (d22, d12, d21, and d11) 318, 320, 322, and 324 of the first and second heart sounds from the 314 and 316.hearts - Referring to
FIGS. 1-4 , aneural network 402 illustrates an exemplary extraction of two statistically independent outputs from the heartsound information 122 captured by two sensors (e.g., thesensors 104 and 106). Theprocessor component 210 passes the heartsound information 122 through a plurality of external nodes of theneural network 402 in number at least equal to the number of the plurality of 304 and 306. At each external node of the plurality of external nodes, thefetuses processor component 210 passes the heartsound information 122 through a plurality of internal nodes of theneural network 402 equal to the number of external nodes to determine one or more weights and one or more delays of each of the heart sounds from the plurality of 304 and 306. For example, thefetuses neural network 406 outputs an M×K matrix of data that represents the heart sounds of the plurality of 304 and 306. The heart sounds of the plurality offetuses 304 and 306 in one example are statistically independent.fetuses - The heart
sound information 122 comprises a plurality of composite heart sounds. For example, the plurality of composite heart sounds comprise a composite heart sound signal (x1) 404 captured by thesensor 104 and a composite heart sound signal (x2) 406 captured by thesensor 104. The outputs of the 104 and 106 are sampled at discrete time points t. The discrete time can be written as t=nT, where n is an integer and T is the time increment between samples. The sampling rate is 1/T samples/sec, and n is called the discrete time index. The composite heart sound signals (x1 and x2) 404 and 406 in one example comprise delayed mixtures of fetal phonocardiogram (s1) produced by thesensors fetus 306 and fetal phonocardiogram (s2) produced by thefetus 304. The composite heart sound signals (x1 and x2) 404 and 406 in one example are modeled by: -
x 1(t)=a 11 s 1(t−d 1)+a 12 s 2(t−d 12) -
x 2(t)=a 21 s 1(t−d 21)+a 22 s 2(t−d 22) - where d22, d12, d21, and d11 represent the propagation delays 318, 320, 322, and 324 of the first and second heart sounds. Also, where all, a12, a21, and a22 represent attenuations of the first and second heart sounds due to signal strength losses traveling through the
abdomen 312 of the woman to the sensors (e.g., thesensors 104 and 106). - The
neural network 402 serves to separate the composite heart sound signals (x1 and x2) 404 and 406 to obtain estimates (u1 and u2) 408 and 410 of the fetal phonocardiograms s1 and s2. The neural network computes: -
u 1(t)=w 11 x 1(t)+w 12 u 2(t−(b 12))+w 01 -
u 2(t)=w 22 x 2(t)+w 21 u 1(t−(b 21))+w 02 - where b12 and b21 represent
414 and 412 between the propagation delays 318, 320, 322, and 324. Also, where w01, w11, w12, w02, w22 and w21 representdelay differences 416, 420, 424, 418, 422, and 426 of theweights neural network 402. - The
428 and 430 that convert the estimates (u1 and u2) 408 and 410 to signals (y1 and y2) 432 and 434 represent nonlinearities described by the equations below. A logistic function relates the estimate (u1) 408 to the signal (y1) 432 and the estimate (u2) 410 to the signal (y2) 434. For example a monotonically increasing nonlinear function converts the estimate (u1) 408 to the signal (y1) 432 and the estimate (u2) 410 to the signal (y2) 434. Below are representative logistic functions that relate the estimate (u1) 408 to the signal (y1) 432 and the estimate (u2) 410 to the signal (y2) 434:blocks -
y 1(t)=g(u 1(t))=1/(1+exp(−u 1(t))) -
y 2(t)=g(u 2(t))=1/(1+exp(−u 2(t))) - Assuming that the fetal phonocardiograms (s1 and s2) are statistically independent, while composite heart sound signals (x1 and x2) 404 and 406 cannot be statistically independent, the parameters (e.g., the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and the delay differences (b12 and b21) 414 and 412) of the
neural network 402 are calculated to make the signals (y1 and y2) 432 and 434 statistically independent. Then, the estimates (u1 and u2) 408 and 410 must also be statistically independent. If the conditions below are achieved: -
b 12 →d 12 −d 22 , w 12 w 22 a 22 →−w 11 a 12 -
b 21 →d 21 −d 11 , w 11 w 21 a 11 →−w 22 a 21 - then the estimate (u1) 408 becomes proportional to the fetal phonocardiogram (s1) and the estimate (u2) 410 becomes proportional to the fetal phonocardiogram (s2), delayed by the propagation delays (d11 and d22) 324 and 318, respectively, which means that the estimates (u1 and u2) 408 and 410 are statistically independent, resulting in:
-
u 1(t)→a 11 w 11 s 1(t−d 11)∝s 1(t−d 11) -
u 2(t)→a 22 w 22 s 2(t−d 22)∝s 2(t−d 22) - Determining the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and the delay differences (b12 and b21) 412 and 414 that will make the signals (y1 and y2) 432 and 434 statistically independent is the goal of the phonocardiogram separator depicted in
FIG. 5 . The recursiveparameter adjustment algorithm 502 to estimate weights and delays of theneural network 402 is based on the gradients given by: -
Δw0i∝(1−2yi) -
Δwii∝(1−2yi)xi+1/wii - for i=1, 2
-
Δwij∝(1−2yi)uj(t−bij) -
Δbij∝−(1−2yi)wijuj(t−bij) -
u j(t)=u j(t)−u j(t−1) - for i, j=1, 2, i≠j
- The formulas above give the gradients of entropy of the signals H(y1, y2) with respect to each of the parameters of the
neural network 402. For example, consider the determination of a parameter of theneural network 402, such as the weight (w11) 420. The gradient of H with respect to the weight (w11) 420 is denoted by Δw11. - For each input sample x1(t) and x2(t), y1(t) and y2(t) and u1(t) and u2(t) can be calculated and then Δw11(t) can also be calculated. Δw11 can be calculated for many (e.g., K) input samples, and then the resulting average of Δw11 can be calculated. Then, the average of Δw11, denoted by Δw11(K), is used to update the value of the weight (w11) 420 with:
-
w 11(new)=w 11(old)+hΔw 11(K) - where h, a small number, is called the learning rate, that is selected by trial and error. Each of the other weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and the delay differences (b12 and b21) 414 and 412 are updated analogously.
- Before moving on to the next set of K input samples, all the updated weights and delay differences are used to calculate Δw11(K) and the other gradients again, and then again the above equation may be used to update w11 and all the other weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and delay differences (b12 and b21) 414 and 412. This loop is continued until the absolute value of |w(new)-w(old)| for all of the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426 and |b(new)-b(old)| for all of the delay differences (b12 and b21) 414 and 412 becomes smaller than some predetermined threshold or the loop has been executed more than a predetermined number of times.
- The blind source separation algorithm that accounts for the propagation delays of the heart
sound information 122 comprises a number of steps. The first step is for theheart sound analyzer 102 to collect a fixed number (e.g., K) of incoming mixture samples in a single frame. The second step is for theheart sound analyzer 102 to calculate the updates to be made to the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and propagation delay differences (b12 and b21) 414 and 412 by iterating over the frame once. This is equivalent to averaging K gradients and updating the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and propagation delay differences (b12 and b21) 414 and 412. The third step is for theheart sound analyzer 102 to repeat the first and second steps until a predetermined number of iterations over a frame have been completed, or the updates to weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and propagation delay differences (b12 and b21) 414 and 412 have become smaller than a predetermined threshold. The fourth step is for theheart sound analyzer 102 to input the next frame, which comprises new incoming data, and discard the last frame. By overlapping successive frames, convergence of the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and propagation delay differences (b12 and b21) 414 and 412 may be smoother. The fifth step is for theheart sound analyzer 102 to repeat the first, second, third, and fourth steps until the weights (w01, w11, w12, w02, w22 and w21) 416, 420, 424, 418, 422, and 426, and propagation delay differences (b12 and b21) 414 and 412 have converged to constants. - Referring to
FIG. 5 , theneural network 402 receives the composite heart sound signals (x1 and x2) 404 and 406 as inputs. A recursiveparameter adjustment algorithm 502 also receives the heart sound signals (x1 and x2) 404 and 406 as inputs. Theneural network 402 produces the estimates (u1 and u2) 408 and 410 and the signals (y1 and y2) 432 and 434. The recursiveparameter adjustment algorithm 502 receives the estimates (u1 and u2) 408 and 410 and the signals (y1 and y2) 432 and 434 as inputs. The recursiveparameter adjustment algorithm 502 serves to determine the parameters (e.g., the weights and delay differences) of theneural network 402. - Referring to FIGS. 1 and 6-8,
602 and 604 illustrate heart sounds of two fetal hearts.fetal phonocardiograms FIG. 7 depicts heart 702 and 704 comprised of mixtures of heart sounds of the two fetal hearts delayed by propagation delays between the fetal hearts and the sensors.sound information 802 and 804 illustrate a separation of the heart sounds of the two fetal hearts from theFetal phonocardiograms 702 and 704. For example, the heartmixed phonocardiograms sound information 122 comprises the two 702 and 704. Thephonocardiogram mixtures heart sound analyzer 102 extracts the heart sound of each of the two fetuses into statistically independent outputs. - The
apparatus 100 in one example comprises a plurality of components such as one or more of electronic components, hardware components, and computer software components. A number of such components can be combined or divided in theapparatus 100. An exemplary component of theapparatus 100 employs and/or comprises a set and/or series of computer instructions written in or implemented with any of a number of programming languages, as will be appreciated by those skilled in the art. - The
apparatus 100 in one example employs one or more computer-readable signal-bearing media. Examples of a computer-readable signal-bearing medium for theapparatus 100 comprise the recordabledata storage medium 146 of theheart sound analyzer 102. For example, the computer-readable signal-bearing medium for theapparatus 100 comprises one or more of a magnetic, electrical, optical, biological, and atomic data storage medium. In one example, the computer-readable signal-bearing medium comprises a modulated carrier signal transmitted over a network comprising or coupled with theapparatus 100, for instance, one or more of a telephone network, a local area network (“LAN”), the internet, and a wireless network. - The steps or operations described herein are just exemplary. There may be many variations to these steps or operations without departing from the spirit of the invention. For instance, the steps may be performed in a differing order, or steps may be added, deleted, or modified.
- Although exemplary implementations of the invention have been depicted and described in detail herein, it will be apparent to those skilled in the relevant art that various modifications, additions, substitutions, and the like can be made without departing from the spirit of the invention and these are therefore considered to be within the scope of the invention as defined in the following claims.
Claims (16)
1-20. (canceled)
21. An apparatus, comprising:
a plurality of acoustic sensors having nonspecific locations on a mother's abdomen; and
a processor that employs the plurality of acoustic sensors to obtain a plurality of sound mixtures of a plurality of sounds from one or more fetal hearts, an additional heart, and background noise;
wherein each of the plurality of sound mixtures obtained by the processor from the plurality of acoustic sensors comprises a different mixture of the plurality of sounds;
wherein the processor extracts from the plurality of sound mixtures any one or more of a plurality of heart sounds from one or more of the one or more fetal hearts and/or the additional heart.
22. The apparatus of claim 21 , wherein the processor employs a blind source separation algorithm that accounts for respective propagation delays of the plurality of heart sounds within the plurality of sound mixtures to extract from the plurality of sound mixtures the any one or more of the plurality of heart sounds from the one or more of the one or more fetal hearts and/or the additional heart.
23. The apparatus of claim 21 , wherein the processor employs an independent component analysis procedure to extract from the plurality of sound mixtures the any one or more of the plurality of heart sounds from the one or more of the one or more fetal hearts and/or the additional heart.
24. The apparatus of claim 21 , wherein the processor employs a neural network construct with a plurality of nodes in number at least equal to a total count of the one or more fetal hearts and the additional heart to extract from the plurality of sound mixtures the any one or more of the plurality of heart sounds from the one or more of the one or more fetal hearts and/or the additional heart.
25. The apparatus of claim 21 , wherein the processor extracts from the plurality of sound mixtures the any one or more of the plurality of heart sounds from the one or more of the one or more fetal hearts and/or the additional heart substantially free of interference from all other of the plurality of heart sounds.
26. The apparatus of claim 21 , wherein the plurality of heart sounds comprises a fetal heart sound from one fetus of the one or more fetuses and an other heart sound from an other living body;
wherein the plurality of sound mixtures comprises a first heart sound mixture, a second heart sound mixture, and a third heart sound mixture;
wherein the first heart sound mixture comprises a contribution from the fetal heart sound, a contribution from the other heart sound, and a contribution from the background noise;
wherein the second heart sound mixture comprises:
a contribution from the fetal heart sound, different from the contribution to the first heart sound mixture;
a contribution from the other heart sound, different from the contribution to the first heart sound mixture; and
a contribution from the background noise, different from the contribution to the first heart sound mixture;
wherein the third heart sound mixture comprises:
a contribution from the fetal heart sound, different from the contribution to the first heart sound mixture and different from the contribution to the second heart sound mixture;
a contribution from the other heart sound, different from the contribution to the first heart sound mixture and different from the contribution to the second heart sound mixture; and
a contribution from the background noise, different from the contribution to the first heart sound mixture and different from the contribution to the second heart sound mixture;
wherein the plurality of acoustic sensors comprises at least a first acoustic sensor having nonspecific abdomen location, a second acoustic sensor having nonspecific abdomen location, and a third acoustic sensor having nonspecific abdomen location;
wherein the processor employs the first acoustic sensor to obtain the first heart sound mixture, wherein the processor employs the second acoustic sensor to obtain the second heart sound mixture, wherein the processor employs the third acoustic sensor to obtain the third heart sound mixture.
27. The apparatus of claim 26 , wherein the processor separates the other heart sound from the fetal heart sound and the background noise and creates a statistically independent output of the other heart sound through employment of the plurality of sound mixtures.
28. The apparatus of claim 26 , wherein the processor separates the fetal heart sound from the other heart sound and the background noise and creates a statistically independent output of the fetal heart sound of the one fetus through employment of the plurality of sound mixtures.
29. The apparatus of claim 28 , wherein the plurality of acoustic sensors comprises three or more microphones locatable over a womb of the mother's abdomen at nonspecific locations for employment by the processor to capture the plurality of sound mixtures of the plurality of sounds to allow the processor to create the statistically independent output of the fetal heart sound of the one fetus.
30. The apparatus of claim 21 , wherein the plurality of acoustic sensors comprises a plurality of microphones in number at least equal to a total count of the one or more fetal hearts and the additional heart, wherein the plurality of microphones is locatable at nonspecific locations over a woman's womb that carries the one or more fetal hearts;
wherein the processor employs the plurality of microphones to obtain and pass the plurality of sound mixtures to the processor.
31. The apparatus of claim 21 , wherein the processor sets one or more propagation delay difference estimates for the plurality of sounds;
wherein the processor iteratively processes the plurality of sound mixtures to converge to the one or more propagation delay difference estimates closer to one or more true propagation delay differences of the plurality of sounds to allow extraction from the plurality of sound mixtures of the any one or more of the plurality of heart sounds from the one or more of the one or more fetal hearts and/or the additional heart.
32. The apparatus of claim 21 , wherein the processor collects one or more samples of the plurality of sound mixtures into a frame;
wherein the processor calculates one or more updates for one or more propagation delay difference and weight estimates for the frame until a predetermined number of processing iterations have occurred or the one or more updates to the one or more propagation delay difference and weight estimates drop below a predetermined threshold.
33. The apparatus of claim 32 , wherein the one or more samples comprise one or more first samples, wherein the frame comprises a first frame, wherein the one or more updates comprise one or more first updates;
wherein after the predetermined number of processing iterations have occurred or the one or more first updates to the one or more propagation delay difference and weight estimates drop below the predetermined threshold, the processor collects one or more second samples of the plurality of sound mixtures into a second frame;
wherein the processor calculates one or more second updates for the one or more propagation delay difference and weight estimates for the second frame until a predetermined number of iterations have occurred or the one or more second updates to the one or more propagation delay difference and weight estimates drop below a predetermined threshold.
34. The apparatus of claim 33 , wherein the processor processes one or more additional frames until the one or more propagation delay difference and weight estimates substantially converge to constants that allow separation of the plurality of sound mixtures into a plurality of independent components.
35. A method, comprising the steps of:
employing a processor coupled with a plurality of acoustic sensors at nonspecific locations on a mother's abdomen to obtain a plurality of different sound mixtures of a plurality of sounds from one or more fetal hearts, an additional heart, and background noise; and
employing the processor to extract from the plurality of sound mixtures any one or more of a plurality of heart sounds from one or more of the one or more fetal hearts and/or the additional heart substantially free of interference from all other of the plurality of heart sounds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/287,249 US20090036789A1 (en) | 2003-07-18 | 2008-10-07 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US48831103P | 2003-07-18 | 2003-07-18 | |
| US53794104P | 2004-01-21 | 2004-01-21 | |
| US10/892,748 US7435224B2 (en) | 2003-07-18 | 2004-07-16 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
| US12/287,249 US20090036789A1 (en) | 2003-07-18 | 2008-10-07 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US10/892,748 Continuation US7435224B2 (en) | 2003-07-18 | 2004-07-16 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20090036789A1 true US20090036789A1 (en) | 2009-02-05 |
Family
ID=34595872
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US10/892,748 Expired - Fee Related US7435224B2 (en) | 2003-07-18 | 2004-07-16 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
| US12/287,249 Abandoned US20090036789A1 (en) | 2003-07-18 | 2008-10-07 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US10/892,748 Expired - Fee Related US7435224B2 (en) | 2003-07-18 | 2004-07-16 | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses |
Country Status (1)
| Country | Link |
|---|---|
| US (2) | US7435224B2 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8920343B2 (en) * | 2006-03-23 | 2014-12-30 | Michael Edward Sabatino | Apparatus for acquiring and processing of physiological auditory signals |
| US20070276251A1 (en) * | 2006-05-02 | 2007-11-29 | Orenstein Nicholas P | Transducers with acoustic impedance matching for passive cardio monitoring |
| US7818050B2 (en) | 2006-05-02 | 2010-10-19 | Lono Medical Systems, Llc | Passive phonography heart monitor |
| US7593765B2 (en) | 2006-05-02 | 2009-09-22 | Lono Medical Systems, Llc | Fetal heart monitoring |
| US7539534B2 (en) * | 2006-05-02 | 2009-05-26 | Lono Medical Systems, Llc | Configuration for phonography cardio heart monitoring |
| CN102090887B (en) * | 2010-12-24 | 2012-11-07 | 深圳市理邦精密仪器股份有限公司 | Fetal heart simulating system and method |
| US20220031256A1 (en) * | 2020-07-31 | 2022-02-03 | 3M Innovative Properties Company | Composite phonocardiogram visualization on an electronic stethoscope display |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4781200A (en) * | 1985-10-04 | 1988-11-01 | Baker Donald A | Ambulatory non-invasive automatic fetal monitoring system |
| US4898179A (en) * | 1985-06-17 | 1990-02-06 | Vladimir Sirota | Device for detecting, monitoring, displaying and recording of material and fetal vital signs and permitting communication between a woman and her fetus |
| US5123420A (en) * | 1991-03-25 | 1992-06-23 | Hewlett-Packard Company | Method and apparatus for processing heart rate traces in a fetal monitor |
| US5515865A (en) * | 1994-04-22 | 1996-05-14 | The United States Of America As Represented By The Secretary Of The Army | Sudden Infant Death Syndrome (SIDS) monitor and stimulator |
| US5718227A (en) * | 1995-08-02 | 1998-02-17 | Lockheed Martin Corporation | Sound localization using parametric ultrasound |
| US5807271A (en) * | 1997-04-14 | 1998-09-15 | Tayebi; Sean | Fetal heartbeat and uterine contraction |
| US5885222A (en) * | 1993-08-30 | 1999-03-23 | Medacoustics, Inc. | Disposable acoustic pad sensors |
| US20010034490A1 (en) * | 2000-02-14 | 2001-10-25 | Bryant Timothy D. | Passive fetal heart monitoring system and method for simultaneously making a plurality of acoustic signal sensor elements |
| US6454716B1 (en) * | 2000-05-23 | 2002-09-24 | P.M.G. Medica Ltd. | System and method for detection of fetal heartbeat |
| US20030187364A1 (en) * | 2002-04-01 | 2003-10-02 | Hamilton Emily F. | Method and apparatus for monitoring the condition of a fetus |
| US20040243015A1 (en) * | 2001-10-03 | 2004-12-02 | Smith Mark John | Apparatus for monitoring fetal heart-beat |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2162644A (en) | 1984-06-29 | 1986-02-05 | Walter Campbell Peaston | Separating heartbeat sources |
| AU2002354800A1 (en) | 2001-07-05 | 2003-01-21 | Softmax, Inc. | System and method for separating cardiac signals |
-
2004
- 2004-07-16 US US10/892,748 patent/US7435224B2/en not_active Expired - Fee Related
-
2008
- 2008-10-07 US US12/287,249 patent/US20090036789A1/en not_active Abandoned
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4898179A (en) * | 1985-06-17 | 1990-02-06 | Vladimir Sirota | Device for detecting, monitoring, displaying and recording of material and fetal vital signs and permitting communication between a woman and her fetus |
| US4781200A (en) * | 1985-10-04 | 1988-11-01 | Baker Donald A | Ambulatory non-invasive automatic fetal monitoring system |
| US5123420A (en) * | 1991-03-25 | 1992-06-23 | Hewlett-Packard Company | Method and apparatus for processing heart rate traces in a fetal monitor |
| US5885222A (en) * | 1993-08-30 | 1999-03-23 | Medacoustics, Inc. | Disposable acoustic pad sensors |
| US5515865A (en) * | 1994-04-22 | 1996-05-14 | The United States Of America As Represented By The Secretary Of The Army | Sudden Infant Death Syndrome (SIDS) monitor and stimulator |
| US5718227A (en) * | 1995-08-02 | 1998-02-17 | Lockheed Martin Corporation | Sound localization using parametric ultrasound |
| US5807271A (en) * | 1997-04-14 | 1998-09-15 | Tayebi; Sean | Fetal heartbeat and uterine contraction |
| US20010034490A1 (en) * | 2000-02-14 | 2001-10-25 | Bryant Timothy D. | Passive fetal heart monitoring system and method for simultaneously making a plurality of acoustic signal sensor elements |
| US6454716B1 (en) * | 2000-05-23 | 2002-09-24 | P.M.G. Medica Ltd. | System and method for detection of fetal heartbeat |
| US20040243015A1 (en) * | 2001-10-03 | 2004-12-02 | Smith Mark John | Apparatus for monitoring fetal heart-beat |
| US20030187364A1 (en) * | 2002-04-01 | 2003-10-02 | Hamilton Emily F. | Method and apparatus for monitoring the condition of a fetus |
Also Published As
| Publication number | Publication date |
|---|---|
| US20050113708A1 (en) | 2005-05-26 |
| US7435224B2 (en) | 2008-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Varady et al. | An advanced method in fetal phonocardiography | |
| US20090036789A1 (en) | Extraction of heart sound of fetus from heart sound information that comprises plurality of mixtures of plurality of heart sounds of plurality of fetuses | |
| US6898459B2 (en) | System and method for diagnosing pathologic heart conditions | |
| US7416531B2 (en) | System and method of detecting and processing physiological sounds | |
| US9717412B2 (en) | Wireless fetal monitoring system | |
| US6678551B2 (en) | Method and apparatus for noise reduction of electromyogram signals | |
| US7532923B1 (en) | Apparatus and method for detecting a fetal heart rate | |
| US6898460B2 (en) | Method and apparatus for uterine contraction monitoring using linear predictive modeling of abdominal surface EMG signals | |
| EP1495721A2 (en) | Biological-sound data processing system, program, and recording medium | |
| JPH11506970A (en) | Method and apparatus for characterizing gastrointestinal sounds | |
| WO1998026716A9 (en) | Piezoelectric sensor for blood pressure measurement | |
| CN102365053A (en) | Health monitoring method and system | |
| CN102755157B (en) | Measuring method of finger tip blood flow rate and measuring instrument thereof | |
| TW201244691A (en) | Heart sound signal/heart disease or cardiopathy distinguishing system and method | |
| US8088082B2 (en) | Fetal movement monitoring system and fetal movement information collecting device | |
| US7001338B2 (en) | System and method for diagnosing pathologic heart conditions | |
| US6339719B1 (en) | Apparatus and method for detecting sounds from a human body and displaying the detected sound information | |
| US11445982B2 (en) | Method and apparatus for determining blood pressure on measured heart sounds | |
| Tan et al. | Real time analysis of fetal phonocardiography | |
| WO2005074794A1 (en) | Heart sound analyzer of heart sound information with a plurality of heart sounds of a plurality of fetuses | |
| Kosa et al. | Experiences with fetal phonocardiographic telemonitoring and future possibilities | |
| CN109512456A (en) | A kind of eight channel Diagnosing Coronary Artery instrument | |
| US20180092606A1 (en) | Heart Sound Processing Method and System for Detecting Cardiopathy | |
| Fahim et al. | Development of a Low-Cost Wireless Phonocardiograph Using Bluetooth Module with a User Friendly Smartphone Application | |
| Andrès | Digital Stethoscope within the Field of Cardiology: Current State, Evidence and Future Directions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |