[go: up one dir, main page]

US12392709B2 - Evaluating assays with optical inhomogeneities - Google Patents

Evaluating assays with optical inhomogeneities

Info

Publication number
US12392709B2
US12392709B2 US16/582,176 US201916582176A US12392709B2 US 12392709 B2 US12392709 B2 US 12392709B2 US 201916582176 A US201916582176 A US 201916582176A US 12392709 B2 US12392709 B2 US 12392709B2
Authority
US
United States
Prior art keywords
image
homogeneity
region
interest
sensing surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/582,176
Other versions
US20200018689A1 (en
Inventor
Toon Hendrik Evers
Derk Jan Wilfred Klunder
Jeroen Hans Nieuwenhuis
Joannes Baptist Adrianus Dionisius Van Zon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Healthineers Nederland BV
Original Assignee
Siemens Healthineers Nederland BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Healthineers Nederland BV filed Critical Siemens Healthineers Nederland BV
Priority to US16/582,176 priority Critical patent/US12392709B2/en
Assigned to KONINKLIJKE PHILIPS N.V. reassignment KONINKLIJKE PHILIPS N.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VAN ZON, JOANNES BAPTIST ADRIANUS DIONISIUS, KLUNDER, DERK JAN WILFRED, EVERS, TOON HENDRIK, NIEUWENHUIS, JEROEN HANS
Publication of US20200018689A1 publication Critical patent/US20200018689A1/en
Assigned to SIEMENS HEALTHINEERS NEDERLAND B.V. reassignment SIEMENS HEALTHINEERS NEDERLAND B.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KONINKLIJKE PHILIPS N.V.
Application granted granted Critical
Publication of US12392709B2 publication Critical patent/US12392709B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55Specular reflectivity
    • G01N21/552Attenuated total reflection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/94Investigating contamination, e.g. dust
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • G01N21/15Preventing contamination of the components of the optical system or obstruction of the light path
    • G01N2021/155Monitoring cleanness of window, lens, or other parts
    • G01N2021/157Monitoring by optical means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/50Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
    • G01N33/52Use of compounds or compositions for colorimetric, spectrophotometric or fluorometric investigation, e.g. use of reagent paper and including single- and multilayer analytical elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30072Microarray; Biochip, DNA array; Well plate
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Definitions

  • Optical measurements may for instance be rejected, i.e. not be taken into account as valid values. In particular, all optical measurements may completely be rejected if an inhomogeneity was detected anywhere on the sensing surface. Alternatively, only those measurements may be rejected that refer to the respective region of interest in which the homogeneity-indicator deviated from the target range (while optical measurements for other regions may still be used). Finally, the rejection may only refer to a sub-area of the affected region of interest. Parts of this region that are sufficiently homogeneous may in this case still contribute to the final measurement results obtained for the assay.
  • the aforementioned rejection of optical measurement (only) for a sub-area of a region of interest requires an appropriate procedure to discriminate between rejected and accepted parts of said region of interest.
  • the sub-area of the region of interest that is rejected can be identified by a deviation of its image values from a given range of image values. If normally the region of interest should for example have gray values from some given interval, those parts (pixels) of the region of interest that have image values outside this interval might be rejected from the evaluation.
  • the present invention further includes a computer program product which provides the functionality of any of the methods according to the present invention when executed on a computing device (also referred to hereinafter as an evaluation unit).
  • the present invention includes a data carrier, for example a floppy disk, a hard disk, an EPROM, or a compact disc (CD-ROM), which stores the computer product in a machine readable form and which executes at least one of the methods of the invention when the program stored on the data carrier is executed on a computing device.
  • a data carrier for example a floppy disk, a hard disk, an EPROM, or a compact disc (CD-ROM), which stores the computer product in a machine readable form and which executes at least one of the methods of the invention when the program stored on the data carrier is executed on a computing device.
  • the data carrier may particularly be suited for storing the program of the computing device mentioned in the previous paragraph.
  • the present invention also includes transmitting the computer product according to the present invention over a local or wide area network.
  • FIG. 1 schematically shows a side view of a sensor device according to the present invention
  • FIG. 4 shows images of a sensing surface with optical distortions before (left) and after (right) wetting by the sample fluid occurs
  • FIG. 7 illustrates an inhomogeneous binding spot at different phases of an assay
  • FIG. 8 shows the image values of the rim and the centre of the binding spot of FIG. 7 .
  • FIGS. 9 - 11 each illustrate a method for evaluating an assay of a sample on a sensing surface according to the present invention.
  • biosensors based on nanoparticle labels particularly based on magnetic beads that can be actuated with electromagnetic fields.
  • biosensors for rapid handheld cardiac testing that allow the detection of cardiac troponin to diagnose myocardial infarct, or handheld parathyroid hormone (PTH) testing products that allow the detection of PTH for interoperative monitoring.
  • PTH handheld parathyroid hormone
  • FIG. 1 shows schematically a side view of a sensor device 100 according to the present invention.
  • This sensor device 100 comprises an exchangeable (disposable) carrier or cartridge 110 with a sample chamber 111 in which a liquid sample can be provided next to a sensing surface 112 .
  • the sensor device comprises an analyzer 150 with which optical measurements can be made at the sensing surface (if the cartridge 110 is properly placed on or in the analyzer).
  • the analyzer 150 comprises an optical sensor unit with a light source 151 (e.g. an LED) for emitting an input light beam L 1 towards the sensing surface, a focusing lens 152 , and an image sensor 153 (2D camera) for detecting an output light beam L 2 returning from the sensing surface 112 .
  • the measurement data (image or pixel values) generated by the image sensor 153 are processed by an evaluation unit 170 .
  • the analyzer 150 comprises magnets 154 and 155 for generating a magnetic field in the sample chamber 111 .
  • the sample comprises magnetic beads 1 functionalized with antibodies that can bind a specific analyte molecule.
  • the beads 1 are attracted to the sensing surface 112 , where they can indirectly (by means of a captured analyte) or directly bind to capture probes (e.g. antibodies) printed on the surface.
  • the number of bound beads is directly or inversely related to the amount of analyte molecules present in the sample.
  • the beads can then be detected using any technique that is more sensitive to beads that are close to the surface.
  • the detection technique is based on evanescent optical fields, namely frustrated total internal reflection (FTIR) as described e.g. in the WO 2008/155716 A1 in more detail.
  • FTIR frustrated total internal reflection
  • the cartridge/fluid interface may be illuminated with an input light beam as shown in FIG. 1 , but the scattered light from the particles near the surface is detected directly using a high NA objective located below the cartridge.
  • FIG. 2 shows in this respect four FTIR images of spots S after magnetic nanoparticles have been bound to the inkjet-printed antibodies.
  • the rectangles “ROI” indicate the regions of interest in which the signal (i.e. the pixel values) are evaluated.
  • the top left image of FIG. 2 shows the desired case of a correctly positioned ROI in a relatively homogeneous spot S.
  • the top right image of FIG. 2 shows a misplaced ROI in a relatively homogeneous spot S.
  • the bottom images of FIG. 2 show spots S with clear inhomogeneities within the ROI.
  • the grayness inside a (rectangular) region of interest (ROI) is averaged to obtain the final result for a considered binding spot S. It is preferred that the ROI covers most of the spot, to enable averaging over more image pixels to obtain a more accurate result. However, it is possible that the ROI contains inhomogeneities in the amount of bound particles on the surface, resulting in an incorrect assay result. Such inhomogeneities in the ROI can be caused by many reasons, e.g.:
  • the present invention proposes to measure the homogeneity of the detected signal in the ROI before, during and/or after the assay. This measurement is done in at least one corresponding “homogeneity-image”, and the result of this measurement is expressed as at last one “homogeneity-indicator”. Based on these measurements (i.e. on the homogeneity-indicator(s)), the entire optical measurement, only certain spots, or only parts of the spots may be rejected.
  • sucrose layer defects can be detected.
  • the cartridge 110 containing the antibody spots S and the dried nanoparticles is inserted into the analyzer 150 before the sample is added. Therefore, an (homogeneity-) image of the cartridge surface 112 before it has been wetted can be obtained.
  • a cause of inhomogeneity in this dry state could be e.g. damage to the (plastic) sensor surface or the entrance and exit windows of the optical path through the cartridge.
  • Another cause could be damage to the protecting layer that is usually applied to preserve the antibody activity using long-term storage.
  • a typical agent for such a protecting layer is sucrose. If the sucrose layer is damaged, the antibodies underneath could be likewise damaged.
  • FIG. 3 shows an example of a “crack” C in the sucrose layer over the area where the antibody spots are printed.
  • the crack C is only visible in the dry state, i.e. before wetting of the sensing surface by the sample ( FIG. 3 left). After wetting, the crack has vanished.
  • the right image in FIG. 3 shows this state after the binding spots S have become visible due to bound magnet beads.
  • the original position of the crack in the sucrose layer can still be seen as a lighter stripe over the antibody printed spots S, i.e. these areas show less binding of magnetic particles. These areas could be chosen to be excluded from the result calculations.
  • defects in the optical path can be detected. This is illustrated in FIG. 4 , which shows two FTIR images of a cartridge before (left) and after wetting by the sample (right).
  • FIG. 4 shows an example of such an inhomogeneity, namely a spot D of dirt, which can still be seen after the sample has been applied.
  • inhomogeneities should not have an effect on the amount of particles binding to the spot and can be compensated for as the final measurements outcome is calculated as a relative change with respect to the grey value before magnetic actuation.
  • at very low signal changes even e.g. a minute shift of the cartridge can result in a relatively large error if such an inhomogeneity is present in the ROI.
  • such an inhomogeneity could also be caused by e.g. dirt, damage to the surface (e.g. a scratch) or the like somewhere else in the optical path (analyzer windows, lenses, sensor etc.). This could indicate a need of servicing/cleaning the analyzer. It is possible to store the shape and location of the inhomogeneity in the analyzer, such that if the same inhomogeneity after wetting is observed during successive measurements, the analyzer indicates that servicing, cleaning, or replacing is in order.
  • air bubbles can be detected. This is illustrated in FIG. 5 , which shows an FTIR image with small air bubbles B, one close to a ROI.
  • air bubbles B can be detected from a single image. Especially if there are small air bubbles on or close to the ROI ( FIG. 5 ), these might not be detected using especially designed wetting detector structures, which are usually not present close to the ROI.
  • the homogeneity of particle density in the binding spot is determined. This is illustrated in FIG. 6 , which shows a sketch of a spot S with an inhomogeneity (left) and a corresponding intensity histogram of the indicated ROI (right).
  • an inhomogeneity detected in a particular image frame (“homogeneity-image”) can be used to correct a result from a later or earlier frame in the measurement.
  • a binding spot S consists of two areas: a main (center) area SI and an outer rim S 2 .
  • the different regions contain a different density of functional antibodies, resulting in different rates at which the particles will bind to the surface.
  • time t 2 the signal change measured for the rim might fall within the predefined homogeneity threshold (as indicated in FIG. 6 ), a more accurate result could be obtained when not taking this rim into account.
  • the main area SI could however be more clearly distinguished from the rim S 2 .
  • FIG. 7 shows the image values G (e.g. gray values) of the rim and the center, respectively.
  • the area containing the inhomogeneity (the outer rim) that is detected at tl could also be excluded in t 2 .
  • an inhomogeneity does not need to be determined from a single frame/measurement, but could also be determined from assessing or averaging multiple (homogeneity-) images.
  • a preferred time would be shortly after a “wash pulse”, removing non-bound particles from the surface.
  • FIG. 9 illustrates a method 900 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170 , according to one or more embodiments.
  • method 900 includes generating a homogeneity-image of the sensing surface, the homogeneity-image including a plurality of pixels, each pixel having an image value.
  • method 900 includes determining whether image values of pixels within at least one region of interest in the homogeneity-image deviate from a given target range of image values.
  • method 900 includes, at process block 906 , accepting the optical measurements from which the homogeneity-image was generated.
  • method 900 includes, at process block 908 , rejecting the optical measurements from which the homogeneity-image was generated.
  • FIG. 10 illustrates a method 1000 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170 , according to one or more embodiments.
  • Method 1000 is a continuation of method 900 from connector A.
  • Method 1000 includes, at process block 1002 , storing as data on a data carrier a shape and a location of an indicated inhomogeneity present on the sensor surface via the homogeneity-image for subsequent comparison with a successively generated homogeneity-image to determine whether servicing, cleaning, or replacing of the sensor device is required.
  • FIG. 11 illustrates a method 1100 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170 , according to one or more embodiments.
  • method 1100 includes generating a homogeneity-image of the sensing surface, the homogeneity-image including a plurality of pixels, each pixel having an image value.
  • method 1100 includes subtractively combining the homogeneity-image with a reference image of at least one region of interest to generate a difference image.
  • method 1100 includes determining whether pixels of the difference image exceed a given target range of image values.
  • method 1100 includes, at process block 1108 , accepting the optical measurements from which the homogeneity-image was generated. In response to the pixels of the difference image exceeding the given target range, method 1100 includes, at process block 1110 , rejecting the optical measurements from which the homogeneity-image was generated.
  • a non-homogeneous loading of an (inkjet-printed) spot of capture probes can result in an incorrect assay result in immunoassays.
  • capture probes e.g. antibodies
  • Methods to detect and to correct for such inhomogeneities and other inhomogeneities that can influence the measurement are provided by the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Pathology (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention relates to a method and a sensor device (100) for evaluating an assay with a sample. During the assay, optical measurements are made at a sensing surface (112), and at least one “homogeneity-image” of the sensing surface (112) is generated. From this image, an “homogeneity-indicator” is determined for at least one region of interest, and the optical measurements are then evaluated in dependence on said indicator. The homogeneity-indicator may for example be a binary value which indicates if an inhomogeneity was detected or not. If an inhomogeneity was detected, all optical measurements may be rejected, only measurements for the involved region of interest may be rejected, or measurements for a selected sub-area of the involved region of interest (ROI) may be rejected.

Description

CROSS-REFERENCE TO PRIOR APPLICATIONS
This is a division of U.S. patent application Ser. No. 14/113,964, filed Oct. 25, 2013, now U.S. Pat. No. 10,466,163, which is the National Stage of International Application No. PCT/IB2012/052028, filed Apr. 23, 2012, which claims the priority of EP Application No. 11164118.9, filed Apr. 28, 2011, all of which are incorporated herein in whole by reference.
FIELD OF THE INVENTION
The invention relates to a method for evaluating an assay comprising the generation of images of a sensing surface. Moreover, it relates to a sensor device for performing and evaluating such an assay.
BACKGROUND OF THE INVENTION
The U.S. Pat. No. 7,410,613 B2 discloses an apparatus in which different spots resulting from a blood test are imaged by an image sensor. To deal with nonuniformities of spots and/or with fine dust in the reaction area, the detected light intensities in a plurality of sub-areas of a spot are statistically processed to yield their mean value, median value, or normal distribution.
SUMMARY OF THE INVENTION
It is an object of the invention to provide means that allow for a more accurate evaluation of measurements which may be impaired by inhomogeneities.
According to its first aspect, the invention relates to a method for evaluating an assay that is performed with a sample, for example with a biological material like blood or saliva. The term “assay” is to be understood here in a quite general sense, comprising in the most simple case the mere provision of a sample for measurements. In many cases, an assay will however comprise some processing of the sample, for example its incubation with reagents, the binding of substances from the sample to probes or the like. The method comprises the following steps:
a) Making optical measurements at a surface, which will be called “sensing surface” in the following and which is (or can be) contacted by the sample. The optical measurements shall include the generation of at least one image of the sensing surface, wherein this image is called “homogeneity-image” in the following (because it is evaluated with respect to homogeneity-aspects).
b) Determining an indicator of the image homogeneity within at least one region of interest in the aforementioned homogeneity-image. This indicator will be called “homogeneity-indicator” in the following. The “image homogeneity” of an image region refers to the spread of image values (e.g. gray values in case of a grayscale image), wherein a completely homogeneous image would be monochrome with a single image value only. The homogeneity-indicator may be a binary variable or value that just expresses if a considered region of interest is homogenous or not (according to some given definition or threshold). It may however also be a multi-valued or even continuous variable by which the degree of homogeneity can be quantified. The homogeneity-indicator may for example correspond to the difference between the minimal and the maximal image value occurring in the region of interest.
c) Evaluating the optical measurements made at the sensing surface in dependence on the aforementioned (at least one) homogeneity-indicator.
It should be noted that the “homogeneity-image” is usually generated during a non-transient phase of an assay, or, with other words, that the “homogeneity-indicator” typically captures non-transient inhomogeneities. In this context, a phase or an inhomogeneity is considered as being “transient” if it lasts at most for several (say 5) seconds. An example would be the transient image inhomogeneity caused by a moving liquid meniscus. The inhomogeneities that are of interest in the context of the present invention, on the contrary, will typically last longer, i.e. for more than 10 s, 60 s etc. or even for the whole duration of an assay.
According to a second aspect, the invention relates to a sensor device for performing and evaluating an assay with a sample, particularly according to a method of the kind described above. The sensor device comprises the following components:
a) A carrier in which a sample can be provided (accommodated), said carrier having a sensing surface which can be contacted by the sample. The carrier may for example be a disposable cartridge that is used for a single measurement with a (biological) sample.
b) An optical sensor unit for making optical measurements at the aforementioned sensing surface, said sensor unit comprising an image sensor by which images of the sensing surface can be generated. In many cases, the optical sensor unit will consist of this image sensor, though it may optionally also comprise further components (e.g. a light source, a spectrometer, etc.).
c) An evaluation unit that is coupled to the optical sensor unit and that may be realized by dedicated electronic hardware, digital data processing hardware with associated software, or a mixture of both. The evaluation unit is adapted to:
    • determine an indicator of the image homogeneity within at least one region of interest of a “homogeneity-image” of the sensing surface that was generated by the image sensor;
    • evaluating the optical measurements provided by the optical sensor unit in dependence on said homogeneity-indicator.
As the method and the sensor device defined above are tightly related, definitions and explanations provided for one of them are analogously applicable to the other one. The method and the sensor device are based on the idea that one or more “homogeneity-indicators” are determined from at least one (“homogeneity-”) image of a sensing region, and that the evaluation of optical measurements during an assay should be based on the results of this determination. Hence the sensing surface (or a region of interest therein) is explicitly checked with respect to a possible (optical) inhomogeneity, which is often caused by effects that also affect the measurements or the assay (e.g. an improper coating of binding sites, a contamination with dirt or the like). If such inhomogeneities are detected, appropriate measures can be taken in order to guarantee the validity and accuracy of the performed optical measurements. This approach allows to achieve much better results than the procedures known from the state of the art, for example from the U.S. Pat. No. 7,410,613 B2, in which inhomogeneities are not separately detected but processed to a mean value or the like.
In the following, various preferred embodiments of the invention will be described that relate to both the sensor device and the method described above.
According to first preferred embodiment, the assay to which the method and the sensor device refer may comprise the specific binding of target components of a sample to at least one binding spot on the sensing surface. The accumulation of the target components at a binding spot may then optically be detected, which allows to determine the presence and/or the amount of target components in the sample. The accuracy of such a measurement can be corrupted if the binding spots are not uniform, for example because they are not evenly coated with binding sites, because they are contaminated by dirt or the like. These situations can however be detected if the homogeneity-indicator is determined in a region of interest above the binding spot.
The aforementioned target components may particularly be labeled by magnetic particles, which allows to manipulate them by magnetic forces. Hence the binding process can be accelerated and/or unbound components can magnetically be washed away from the sensing surface before a measurement. More details about such assays and appropriate optical measurements are for example described in the WO 2008/155716 A1, WO 2009/125339 A2, WO 2009/001276 A1, or WO 2008/142492 A1, which are incorporated into the present application by reference.
The optical measurements at the sensing surface may preferably comprise or completely consist of the generation of a plurality of images of the sensing surface. Hence the image sensor that is used to produce the homogeneity-image can also be used to provide the optical measurements or at least a part thereof. In particular, the homogeneity-image can just be one of the optical measurements.
In one embodiment of the invention, the homogeneity-indicator may be determined by a feature detection procedure operating on the homogeneity-image. The feature detection procedure may for example identify non-uniform image structures that originate from gas bubbles at the sensing surface. When suspect features are detected in a region of interest, the corresponding homogeneity-indicator may be set to a value indicating the presence of an inhomogeneity.
According to another embodiment of the invention, the homogeneity-indicator may be determined from a histogram of image values in the region of interest. As known to a person skilled in the art, a histogram represent the frequency with which certain image values (e.g. gray values between 0 and 255) occur within the region of interest. If this region is homogeneous, the corresponding histogram has a sharp (ideally single-valued) peak. Deviations from this kind of histogram will hence be an indicator of image inhomogeneities. In particular, the region of interest may be assumed to be inhomogeneous if its histogram has more than one peak.
In still another embodiment of the invention, the homogeneity-indicator is determined from a comparison of the homogeneity-image with reference data, particularly from a comparison with one or more reference images of the region of interest. The reference images may for example be images of cartridges which are known to function well. Moreover, the comparison may especially comprise a comparison (or, more specifically, a subtraction) of histograms of the measured homogeneity image and the reference image.
Depending on the type of assay, there may be different times at which an homogeneity-image should be generated. An homogeneity-image may particularly be generated at these start of the assay, the end of the assay, or during the ongoing assay. Of course it is also possible to generate a plurality of homogeneity-images at different times of an assay.
If more than one homogeneity-indicator is determined for an assay, the evaluation of optical measurements may be based on a comparison of these. In particular, homogeneity-indicators (typically for the same region of interest) of homogeneity-images generated during different phases of the assay may be compared. Different phases of an assay may give rise to the appearance or disappearance of certain distortions. The corresponding change in the homogeneity-indicators will hence often allow to infer which kind of distortion is present.
The aforementioned different phases of the assay may particularly include phases before and after a wetting of the sensing surface with a sample occurs. Such a wetting nearly always occurs in assays in which a liquid sample is used, because this sample must, as a first step, be introduced into the space where the measurements take place. Hence there will usually always be an opportunity to observe and compare phases before and after such a wetting. As was already explained above, the change of the homogeneity-indicator during wetting allows some conclusions about the possible kinds of distortion, for example:
    • If an initially present inhomogeneity vanishes during wetting, this may be due to irregularities within a soluble component, for example due to cracks in a protective sucrose layer above binding spots.
    • If an inhomogeneity appears during wetting, this may be due to the presence of dirt or gas bubbles in the sample.
    • If an inhomogeneity remains unchanged during wetting, it may be caused by disturbances in the optical path, for example by dirt or scratches on optical windows.
If the determined homogeneity-indicator of at least one region of interest deviates from a given target range of “normal” or “allowable” values, this can have different consequences for the evaluation of the optical measurements. Optical measurements may for instance be rejected, i.e. not be taken into account as valid values. In particular, all optical measurements may completely be rejected if an inhomogeneity was detected anywhere on the sensing surface. Alternatively, only those measurements may be rejected that refer to the respective region of interest in which the homogeneity-indicator deviated from the target range (while optical measurements for other regions may still be used). Finally, the rejection may only refer to a sub-area of the affected region of interest. Parts of this region that are sufficiently homogeneous may in this case still contribute to the final measurement results obtained for the assay.
The aforementioned rejection of optical measurement (only) for a sub-area of a region of interest requires an appropriate procedure to discriminate between rejected and accepted parts of said region of interest. In particular, the sub-area of the region of interest that is rejected can be identified by a deviation of its image values from a given range of image values. If normally the region of interest should for example have gray values from some given interval, those parts (pixels) of the region of interest that have image values outside this interval might be rejected from the evaluation.
The method according to the invention will typically be realized with the help of a computing device, e.g., with a microcontroller or a personal computer. Accordingly, the present invention further includes a computer program product which provides the functionality of any of the methods according to the present invention when executed on a computing device (also referred to hereinafter as an evaluation unit).
Further, the present invention includes a data carrier, for example a floppy disk, a hard disk, an EPROM, or a compact disc (CD-ROM), which stores the computer product in a machine readable form and which executes at least one of the methods of the invention when the program stored on the data carrier is executed on a computing device. The data carrier may particularly be suited for storing the program of the computing device mentioned in the previous paragraph.
Nowadays, such software is often offered on the Internet or a company Intranet for download, hence the present invention also includes transmitting the computer product according to the present invention over a local or wide area network.
The invention further relates to the use of the sensor device described above for molecular diagnostics, biological sample analysis, chemical sample analysis, food analysis, and/or forensic analysis. Molecular diagnostics may for example be accomplished with the help of magnetic beads or fluorescent particles that are directly or indirectly attached to target molecules.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
In the drawings:
FIG. 1 schematically shows a side view of a sensor device according to the present invention;
FIG. 2 shows exemplary images of binding spots together with the corresponding regions of interest where image values are evaluated;
FIG. 3 shows images of a sensing surface with cracks in a protective sucrose layer before (left) and after (right) wetting by the sample fluid occurs;
FIG. 4 shows images of a sensing surface with optical distortions before (left) and after (right) wetting by the sample fluid occurs;
FIG. 5 shows an image of a sensing surface with air bubbles;
FIG. 6 illustrates the evaluation of an inhomogeneous region of interest with the help of a histogram;
FIG. 7 illustrates an inhomogeneous binding spot at different phases of an assay;
FIG. 8 shows the image values of the rim and the centre of the binding spot of FIG. 7 .
FIGS. 9-11 each illustrate a method for evaluating an assay of a sample on a sensing surface according to the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS
In the following, the invention will be described with respect to biosensors based on nanoparticle labels, particularly based on magnetic beads that can be actuated with electromagnetic fields. Particular examples are biosensors for rapid handheld cardiac testing that allow the detection of cardiac troponin to diagnose myocardial infarct, or handheld parathyroid hormone (PTH) testing products that allow the detection of PTH for interoperative monitoring. It should however be noted that the invention is not restricted to these applications but can be used for sample examination in general.
FIG. 1 shows schematically a side view of a sensor device 100 according to the present invention. This sensor device 100 comprises an exchangeable (disposable) carrier or cartridge 110 with a sample chamber 111 in which a liquid sample can be provided next to a sensing surface 112. Moreover, the sensor device comprises an analyzer 150 with which optical measurements can be made at the sensing surface (if the cartridge 110 is properly placed on or in the analyzer). The analyzer 150 comprises an optical sensor unit with a light source 151 (e.g. an LED) for emitting an input light beam L1 towards the sensing surface, a focusing lens 152, and an image sensor 153 (2D camera) for detecting an output light beam L2 returning from the sensing surface 112. The measurement data (image or pixel values) generated by the image sensor 153 are processed by an evaluation unit 170. Moreover, the analyzer 150 comprises magnets 154 and 155 for generating a magnetic field in the sample chamber 111.
Typically, the sample comprises magnetic beads 1 functionalized with antibodies that can bind a specific analyte molecule. The beads 1 are attracted to the sensing surface 112, where they can indirectly (by means of a captured analyte) or directly bind to capture probes (e.g. antibodies) printed on the surface. The number of bound beads is directly or inversely related to the amount of analyte molecules present in the sample. The beads can then be detected using any technique that is more sensitive to beads that are close to the surface. In the shown example, the detection technique is based on evanescent optical fields, namely frustrated total internal reflection (FTIR) as described e.g. in the WO 2008/155716 A1 in more detail.
In another detection principle, the cartridge/fluid interface may be illuminated with an input light beam as shown in FIG. 1 , but the scattered light from the particles near the surface is detected directly using a high NA objective located below the cartridge.
After an assay executed with the sensor device 100, the darkness of the camera image in the spot S where capture probes (antibodies) have been printed is a measure of how many particles have been bound to the spot S. FIG. 2 shows in this respect four FTIR images of spots S after magnetic nanoparticles have been bound to the inkjet-printed antibodies. The rectangles “ROI” indicate the regions of interest in which the signal (i.e. the pixel values) are evaluated.
The top left image of FIG. 2 shows the desired case of a correctly positioned ROI in a relatively homogeneous spot S.
The top right image of FIG. 2 shows a misplaced ROI in a relatively homogeneous spot S.
The bottom images of FIG. 2 show spots S with clear inhomogeneities within the ROI.
Usually, the grayness inside a (rectangular) region of interest (ROI) is averaged to obtain the final result for a considered binding spot S. It is preferred that the ROI covers most of the spot, to enable averaging over more image pixels to obtain a more accurate result. However, it is possible that the ROI contains inhomogeneities in the amount of bound particles on the surface, resulting in an incorrect assay result. Such inhomogeneities in the ROI can be caused by many reasons, e.g.:
    • a misplacement of the ROI over the spot (FIG. 2 , top right);
    • an inhomogeneous loading of antibodies within the spot (e.g. caused by formation of salt crystals during drying of the printed spots);
    • a partial damaging of the antibodies in the spot.
To prevent incorrect results, the present invention proposes to measure the homogeneity of the detected signal in the ROI before, during and/or after the assay. This measurement is done in at least one corresponding “homogeneity-image”, and the result of this measurement is expressed as at last one “homogeneity-indicator”. Based on these measurements (i.e. on the homogeneity-indicator(s)), the entire optical measurement, only certain spots, or only parts of the spots may be rejected.
This general approach will in the following be explained with respect to details of several preferred embodiments, relating to detecting inhomogeneities with different causes and at different times during the entire assay procedure.
In a first embodiment, sucrose layer defects can be detected. In a normal workflow, the cartridge 110 containing the antibody spots S and the dried nanoparticles is inserted into the analyzer 150 before the sample is added. Therefore, an (homogeneity-) image of the cartridge surface 112 before it has been wetted can be obtained. A cause of inhomogeneity in this dry state could be e.g. damage to the (plastic) sensor surface or the entrance and exit windows of the optical path through the cartridge. Another cause could be damage to the protecting layer that is usually applied to preserve the antibody activity using long-term storage. A typical agent for such a protecting layer is sucrose. If the sucrose layer is damaged, the antibodies underneath could be likewise damaged.
FIG. 3 shows an example of a “crack” C in the sucrose layer over the area where the antibody spots are printed. The crack C is only visible in the dry state, i.e. before wetting of the sensing surface by the sample (FIG. 3 left). After wetting, the crack has vanished. The right image in FIG. 3 shows this state after the binding spots S have become visible due to bound magnet beads. The original position of the crack in the sucrose layer can still be seen as a lighter stripe over the antibody printed spots S, i.e. these areas show less binding of magnetic particles. These areas could be chosen to be excluded from the result calculations.
In a second embodiment, defects in the optical path can be detected. This is illustrated in FIG. 4 , which shows two FTIR images of a cartridge before (left) and after wetting by the sample (right).
As explained above, inhomogeneities C caused by the sucrose layer disappear after applying the sample. If inhomogeneities still exist, these could be caused by e.g. dirt or damages on the optical windows where the light beams enter/exit the cartridge (FIG. 1 ). FIG. 4 shows an example of such an inhomogeneity, namely a spot D of dirt, which can still be seen after the sample has been applied. In principle, such inhomogeneities should not have an effect on the amount of particles binding to the spot and can be compensated for as the final measurements outcome is calculated as a relative change with respect to the grey value before magnetic actuation. However, at very low signal changes, even e.g. a minute shift of the cartridge can result in a relatively large error if such an inhomogeneity is present in the ROI.
In principle, such an inhomogeneity could also be caused by e.g. dirt, damage to the surface (e.g. a scratch) or the like somewhere else in the optical path (analyzer windows, lenses, sensor etc.). This could indicate a need of servicing/cleaning the analyzer. It is possible to store the shape and location of the inhomogeneity in the analyzer, such that if the same inhomogeneity after wetting is observed during successive measurements, the analyzer indicates that servicing, cleaning, or replacing is in order.
In a third embodiment, air bubbles can be detected. This is illustrated in FIG. 5 , which shows an FTIR image with small air bubbles B, one close to a ROI.
The inclusion of air bubbles in the measurement chamber is another important cause of inhomogeneity in the image after wetting by the sample. With appropriate image processing algorithms, air bubbles B can be detected from a single image. Especially if there are small air bubbles on or close to the ROI (FIG. 5 ), these might not be detected using especially designed wetting detector structures, which are usually not present close to the ROI.
In a fourth embodiment, the homogeneity of particle density in the binding spot is determined. This is illustrated in FIG. 6 , which shows a sketch of a spot S with an inhomogeneity (left) and a corresponding intensity histogram of the indicated ROI (right).
As shown in FIG. 2 , there can be inhomogeneities in the particle density after magnetic particles have been bound to a binding spot S. These inhomogeneities can be detected by proper image processing algorithms, and the corresponding area can be excluded from the measurement, or the whole measurement can be rejected.
A simple algorithm to achieve this is illustrated in FIG. 6 . If a homogeneous spot S is subdivided in many smaller areas (with the smallest possible area being a single pixel on an image), a histogram of their intensities would yield a narrow distribution of gray values. However, if an inhomogeneity (e.g. a lighter area) is present, this would appear as an additional peak at different gray values (cf. FIG. 6 right). One possibility to detect or exclude the corresponding area is to set a threshold on the width of the detected main peak, such that all values that fall outside the threshold are not used to calculate the average gray value of the ROI. Of course, more advanced image processing algorithms that also take the position of the inhomogeneous areas into account could also be applied.
It has to be noted that for all embodiments described above, an inhomogeneity detected in a particular image frame (“homogeneity-image”) can be used to correct a result from a later or earlier frame in the measurement. In the situation shown in FIG. 7 , a binding spot S consists of two areas: a main (center) area SI and an outer rim S2. The different regions contain a different density of functional antibodies, resulting in different rates at which the particles will bind to the surface. Although at the end of the assay (time t2) the signal change measured for the rim might fall within the predefined homogeneity threshold (as indicated in FIG. 6 ), a more accurate result could be obtained when not taking this rim into account. Because the signal in the rim saturates, the difference in signal between the two areas becomes very small at t2. In an earlier point in time of the assay (t1), the main area SI could however be more clearly distinguished from the rim S2. This can be seen from FIG. 7 , which shows the image values G (e.g. gray values) of the rim and the center, respectively. The area containing the inhomogeneity (the outer rim) that is detected at tl could also be excluded in t2.
Furthermore, an inhomogeneity does not need to be determined from a single frame/measurement, but could also be determined from assessing or averaging multiple (homogeneity-) images. For homogeneity detection during actuation of magnetic beads, a preferred time would be shortly after a “wash pulse”, removing non-bound particles from the surface.
FIG. 9 illustrates a method 900 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170, according to one or more embodiments. At process block 902, method 900 includes generating a homogeneity-image of the sensing surface, the homogeneity-image including a plurality of pixels, each pixel having an image value. At decision block 904, method 900 includes determining whether image values of pixels within at least one region of interest in the homogeneity-image deviate from a given target range of image values. In response to the image values of the pixels not deviating from the given target range, method 900 includes, at process block 906, accepting the optical measurements from which the homogeneity-image was generated. In response to the image values of the pixels deviating from the given target range, method 900 includes, at process block 908, rejecting the optical measurements from which the homogeneity-image was generated.
FIG. 10 illustrates a method 1000 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170, according to one or more embodiments. Method 1000 is a continuation of method 900 from connector A. Method 1000 includes, at process block 1002, storing as data on a data carrier a shape and a location of an indicated inhomogeneity present on the sensor surface via the homogeneity-image for subsequent comparison with a successively generated homogeneity-image to determine whether servicing, cleaning, or replacing of the sensor device is required.
FIG. 11 illustrates a method 1100 of evaluating an assay of a sample on a sensing surface, executable by evaluation unit 170, according to one or more embodiments. At process block 1102, method 1100 includes generating a homogeneity-image of the sensing surface, the homogeneity-image including a plurality of pixels, each pixel having an image value. At process block 1104, method 1100 includes subtractively combining the homogeneity-image with a reference image of at least one region of interest to generate a difference image. At decision block 1106, method 1100 includes determining whether pixels of the difference image exceed a given target range of image values. In response to the pixels of the difference image not exceeding the given target range, method 1100 includes, at process block 1108, accepting the optical measurements from which the homogeneity-image was generated. In response to the pixels of the difference image exceeding the given target range, method 1100 includes, at process block 1110, rejecting the optical measurements from which the homogeneity-image was generated.
In summary, a non-homogeneous loading of an (inkjet-printed) spot of capture probes (e.g. antibodies) can result in an incorrect assay result in immunoassays. Methods to detect and to correct for such inhomogeneities and other inhomogeneities that can influence the measurement are provided by the present invention. To prevent incorrect results, it is proposed to measure the homogeneity of the detected signal in the ROI during the entire assay and to either correct for inhomogeneities in a given frame by only taking into account those areas that satisfy preset homogeneity requirements of all captured frames or, if certain homogeneity requirements are not met, reject the assay result.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.

Claims (15)

The invention claimed is:
1. A sensor device for performing and evaluating an assay with a sample, comprising:
a carrier with a sensing surface that can be contacted by the sample, the carrier comprising a sample chamber, the sample chamber comprising the sensing surface and configured to receive the sample;
an optical sensor unit for making optical measurements at the sensing surface, the optical sensor unit comprising an image sensor by which a homogeneity-image of the sensing surface can be generated, the homogeneity-image including a plurality of pixels, each pixel having an image value; and
an evaluation unit coupled to the optical sensor unit, the evaluation unit comprising digital data processing-hardware executing software to:
determine whether image values of pixels within at least one region of interest in the homogeneity-image of the sensing surface deviate from a given target range of image values, wherein homogeneity is based on image values of the pixels falling within the given target range and inhomogeneity is based on the image values deviating from the given target range;
reject the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating inhomogeneity; and
accept the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating homogeneity.
2. The sensor device according to claim 1, wherein the optical sensor unit further comprises a light source for emitting a light beam towards the sensing surface.
3. The sensor device according to claim 2, wherein the light source comprises a light-emitting-diode (LED).
4. The sensor device according to claim 1, wherein the optical sensor unit further comprises a focusing lens positioned between the sensing surface and the image sensor.
5. The sensor device according to claim 1, wherein the image sensor comprises a two-dimensional camera.
6. The sensor device according to claim 1, further comprising a data carrier for storing the software.
7. The sensor device according to claim 1, wherein the sample chamber further comprises magnetic beads disposed about the sensing surface.
8. The sensor device according to claim 7, further comprising a pair of magnets disposed about the sample chamber to generate a magnetic field in the sample chamber.
9. The sensor device according to claim 1, wherein the image sensor is configured to generate the homogeneity-image at the start of the assay, during the assay, or at the end of the assay.
10. The sensor device according to claim 1, wherein to determine whether the image values of pixels within the at least one region of interest in the homogeneity-image deviate from a given target range, the digital data processing-hardware further executes software to:
generate a histogram of the image values of the pixels within the at least one region of interest; and
determine whether a width of a main peak of the histogram falls within a given range.
11. The sensor device according to claim 1, wherein the assay detects parathyroid hormone (PTH).
12. The sensor device according to claim 1, wherein the assay detects cardiac troponin.
13. A sensor device for performing and evaluating an assay with a sample, comprising:
a carrier with a sensing surface that can be contacted by the sample;
an optical sensor unit for making optical measurements at the sensing surface, the optical sensor unit comprising an image sensor by which a homogeneity-image of the sensing surface can be generated, the homogeneity-image including a plurality of pixels, each pixel having an image value; and
an evaluation unit coupled to the optical sensor unit, the evaluation unit comprising digital data processing-hardware executing software to:
determine whether image values of pixels within at least one region of interest in the homogeneity-image of the sensing surface deviate from a given target range of image values, wherein homogeneity is based on image values of the pixels falling within the given target range and inhomogeneity is based on the image values deviating from the given target range;
reject the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating inhomogeneity; and
accept the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating homogeneity;
wherein the image sensor is configured to generate a plurality of homogeneity-images at different times of the assay.
14. A sensor device for performing and evaluating an assay with a sample, comprising:
a carrier with a sensing surface that can be contacted by the sample;
an optical sensor unit for making optical measurements at the sensing surface, the optical sensor unit comprising an image sensor by which a homogeneity-image of the sensing surface can be generated, the homogeneity-image including a plurality of pixels, each pixel having an image value; and
an evaluation unit coupled to the optical sensor unit, the evaluation unit comprising a data carrier and digital data processing-hardware executing software stored on the data carrier to:
determine whether image values of pixels within at least one region of interest in the homogeneity-image of the sensing surface deviate from a given target range of image values, wherein homogeneity is based on image values of the pixels falling within the given target range and inhomogeneity is based on the image values deviating from the given target range;
reject the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating inhomogeneity; and
accept the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating homogeneity;
wherein the digital data processing-hardware further executes software to store as data on the data carrier a shape and a location of an indicated inhomogeneity present on the sensor surface via the homogeneity-image for subsequent comparison with a successively generated homogeneity-image to determine whether servicing, cleaning, or replacing of the sensor device is required.
15. A sensor device for performing and evaluating an assay with a sample, comprising:
a carrier with a sensing surface that can be contacted by the sample;
an optical sensor unit for making optical measurements at the sensing surface, the optical sensor unit comprising an image sensor by which a homogeneity-image of the sensing surface can be generated, the homogeneity-image including a plurality of pixels, each pixel having an image value; and
an evaluation unit coupled to the optical sensor unit, the evaluation unit comprising digital data processing-hardware executing software to:
determine whether image values of pixels within at least one region of interest in the homogeneity-image of the sensing surface indicate homogeneity or inhomogeneity based on a given target range of image values;
reject the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating inhomogeneity; and
accept the optical measurements provided by the optical sensor unit for the at least one region of interest in response to the image values of pixels within the at least one region of interest indicating homogeneity;
wherein the digital data processing-hardware further executes software to determine whether the image values of pixels within at least one region of interest in the homogeneity-image of the sensing surface indicate homogeneity or inhomogeneity by subtractively combining the homogeneity-image with a reference image of the at least one region of interest to generate a difference image and by comparing pixel values of the difference image to the given target range.
US16/582,176 2011-04-28 2019-09-25 Evaluating assays with optical inhomogeneities Active 2036-09-14 US12392709B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/582,176 US12392709B2 (en) 2011-04-28 2019-09-25 Evaluating assays with optical inhomogeneities

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
EP11164118 2011-04-28
EP11164118 2011-04-28
EP11164118.9 2011-04-28
PCT/IB2012/052028 WO2012147021A1 (en) 2011-04-28 2012-04-23 Evaluating assays which optical inhomogeneities
US201314113964A 2013-10-25 2013-10-25
US16/582,176 US12392709B2 (en) 2011-04-28 2019-09-25 Evaluating assays with optical inhomogeneities

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
PCT/IB2012/052028 Division WO2012147021A1 (en) 2011-04-28 2012-04-23 Evaluating assays which optical inhomogeneities
US14/113,964 Division US10466163B2 (en) 2011-04-28 2012-04-23 Concurrently evaluating assays with optical inhomogeneities

Publications (2)

Publication Number Publication Date
US20200018689A1 US20200018689A1 (en) 2020-01-16
US12392709B2 true US12392709B2 (en) 2025-08-19

Family

ID=46062675

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/113,964 Active 2033-12-20 US10466163B2 (en) 2011-04-28 2012-04-23 Concurrently evaluating assays with optical inhomogeneities
US16/582,176 Active 2036-09-14 US12392709B2 (en) 2011-04-28 2019-09-25 Evaluating assays with optical inhomogeneities

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/113,964 Active 2033-12-20 US10466163B2 (en) 2011-04-28 2012-04-23 Concurrently evaluating assays with optical inhomogeneities

Country Status (5)

Country Link
US (2) US10466163B2 (en)
EP (1) EP2702392B1 (en)
JP (1) JP6190358B2 (en)
CN (1) CN103620392B (en)
WO (1) WO2012147021A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012004735A1 (en) * 2010-07-09 2012-01-12 Koninklijke Philips Electronics N.V. Cartridge with large-scale manufacturing design
KR101517594B1 (en) 2013-10-16 2015-05-04 (주)타스컴 Biosensor
ES3036495T3 (en) * 2018-02-19 2025-09-19 Hoffmann La Roche Method and devices for performing an analytical measurement
EP3948226A4 (en) * 2019-04-05 2023-09-06 Essenlix Corporation TEST ACCURACY AND RELIABILITY IMPROVEMENT

Citations (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4989973A (en) 1988-10-03 1991-02-05 Nissan Motor Co., Ltd. Surface condition estimating apparatus
US5331396A (en) 1991-10-08 1994-07-19 Matsushita Electric Industrial Co., Ltd. Foreign matter detection device
US5790691A (en) 1996-03-12 1998-08-04 The Regents Of The University Of Colorado Method and apparatus for robust shape detection using a hit/miss transform
US5795725A (en) * 1995-04-18 1998-08-18 Biosite Diagnostics Incorporated Methods for the assay of troponin I and T and selection of antibodies for use in immunoassays
US5907396A (en) 1996-09-20 1999-05-25 Nikon Corporation Optical detection system for detecting defects and/or particles on a substrate
US6055060A (en) 1996-07-16 2000-04-25 Boehringer Mannheim Gmbh Analytical system with means for detecting too small sample volumes
US6175645B1 (en) 1998-01-22 2001-01-16 Applied Materials, Inc. Optical inspection method and apparatus
US20030043550A1 (en) 2001-09-05 2003-03-06 Thomas W. Ives Methods and apparatus for securing disk drives in a disk array
WO2003021853A2 (en) 2001-09-05 2003-03-13 Genicon Sciences Corporation Apparatus for reading signals generated from resonance light scattered particle labels
US6689566B1 (en) * 1999-01-14 2004-02-10 Scantibodies Laboratory, Inc. Methods, kits, and antibodies for detecting parathyroid hormone
US20050014174A1 (en) 2003-05-21 2005-01-20 Bayer Technology Services Gmbh Method for the detection of nucleic acids
US20050078860A1 (en) * 2003-10-14 2005-04-14 Minor James M. Feature quantitation methods and system
US20050110989A1 (en) 2003-11-21 2005-05-26 Schermer Mack J. Optical device integrated with well
US20050153290A1 (en) 2001-12-21 2005-07-14 Van Beuningen Marinus Gerardus J. Normalisation of microarray data based on hybridisation with an internal reference
JP2007017282A (en) 2005-07-07 2007-01-25 Sony Corp Biological data processor, biological data processing method, learning device, learning control method, program and recording medium
US20080089568A1 (en) * 2006-10-12 2008-04-17 Delenstarr Glenda C Method and system for dynamic, automated detection of outlying feature and feature background regions during processing of data scanned from a chemical array
WO2008072156A2 (en) 2006-12-12 2008-06-19 Koninklijke Philips Electronics N. V. Microelectronic sensor device for detecting label particles
US20080181458A1 (en) 2005-07-29 2008-07-31 Olympus Corporation Light intensity measurement method and light intensity measurement system
US7410613B2 (en) 2002-03-28 2008-08-12 Fujifilm Corporation Humoral testing apparatus
WO2008142492A1 (en) 2007-05-22 2008-11-27 Koninklijke Philips Electronics N.V. Method for detecting label particles
WO2008155716A1 (en) 2007-06-21 2008-12-24 Koninklijke Philips Electronics N. V. Microelectronic sensor device for detecting label particles
WO2009001276A1 (en) 2007-06-25 2008-12-31 Koninklijke Philips Electronics N.V. Microelectronic sensor device for detecting label particles
US20090074285A1 (en) 2006-05-15 2009-03-19 Nikon Corporation Surface inspection device
WO2009125339A2 (en) 2008-04-09 2009-10-15 Koninklijke Philips Electronics N. V. A carrier for optical detection in small sample volumes
CN101655462A (en) 2009-09-11 2010-02-24 中国科学院地理科学与资源研究所 Apparatus for obtaining water quality information, method and system for recognizing water body eutrophication degree
DE102009003548A1 (en) 2009-02-27 2010-09-02 Leibniz-Institut für Analytische Wissenschaften-ISAS-e.V. Method for the high-resolution detection of nanoparticles on two-dimensional measuring surfaces
WO2011027291A1 (en) 2009-09-07 2011-03-10 Koninklijke Philips Electronics N.V. Sensor cartridge with dissolvable cover layer
US8160348B2 (en) 2007-08-06 2012-04-17 Historx, Inc. Methods and system for validating sample images for quantitative immunoassays
US20120250005A1 (en) 2009-09-28 2012-10-04 Koninklijke Philips Electronics N.V. Biosensor system for single particle detection

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3880361B2 (en) * 2001-10-17 2007-02-14 日立ソフトウエアエンジニアリング株式会社 Fluorescence signal processing method and hybridization reaction result display method
JP4736516B2 (en) * 2005-04-22 2011-07-27 ソニー株式会社 Biological information processing apparatus and method, program, and recording medium

Patent Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4989973A (en) 1988-10-03 1991-02-05 Nissan Motor Co., Ltd. Surface condition estimating apparatus
US5331396A (en) 1991-10-08 1994-07-19 Matsushita Electric Industrial Co., Ltd. Foreign matter detection device
US5795725A (en) * 1995-04-18 1998-08-18 Biosite Diagnostics Incorporated Methods for the assay of troponin I and T and selection of antibodies for use in immunoassays
US5790691A (en) 1996-03-12 1998-08-04 The Regents Of The University Of Colorado Method and apparatus for robust shape detection using a hit/miss transform
US6055060A (en) 1996-07-16 2000-04-25 Boehringer Mannheim Gmbh Analytical system with means for detecting too small sample volumes
US5907396A (en) 1996-09-20 1999-05-25 Nikon Corporation Optical detection system for detecting defects and/or particles on a substrate
US6175645B1 (en) 1998-01-22 2001-01-16 Applied Materials, Inc. Optical inspection method and apparatus
US6689566B1 (en) * 1999-01-14 2004-02-10 Scantibodies Laboratory, Inc. Methods, kits, and antibodies for detecting parathyroid hormone
US20030043550A1 (en) 2001-09-05 2003-03-06 Thomas W. Ives Methods and apparatus for securing disk drives in a disk array
WO2003021853A2 (en) 2001-09-05 2003-03-13 Genicon Sciences Corporation Apparatus for reading signals generated from resonance light scattered particle labels
US20050153290A1 (en) 2001-12-21 2005-07-14 Van Beuningen Marinus Gerardus J. Normalisation of microarray data based on hybridisation with an internal reference
US7410613B2 (en) 2002-03-28 2008-08-12 Fujifilm Corporation Humoral testing apparatus
US20050014174A1 (en) 2003-05-21 2005-01-20 Bayer Technology Services Gmbh Method for the detection of nucleic acids
US20050078860A1 (en) * 2003-10-14 2005-04-14 Minor James M. Feature quantitation methods and system
US20050110989A1 (en) 2003-11-21 2005-05-26 Schermer Mack J. Optical device integrated with well
JP2007017282A (en) 2005-07-07 2007-01-25 Sony Corp Biological data processor, biological data processing method, learning device, learning control method, program and recording medium
US20080181458A1 (en) 2005-07-29 2008-07-31 Olympus Corporation Light intensity measurement method and light intensity measurement system
US20090074285A1 (en) 2006-05-15 2009-03-19 Nikon Corporation Surface inspection device
US20080089568A1 (en) * 2006-10-12 2008-04-17 Delenstarr Glenda C Method and system for dynamic, automated detection of outlying feature and feature background regions during processing of data scanned from a chemical array
WO2008072156A2 (en) 2006-12-12 2008-06-19 Koninklijke Philips Electronics N. V. Microelectronic sensor device for detecting label particles
WO2008142492A1 (en) 2007-05-22 2008-11-27 Koninklijke Philips Electronics N.V. Method for detecting label particles
WO2008155716A1 (en) 2007-06-21 2008-12-24 Koninklijke Philips Electronics N. V. Microelectronic sensor device for detecting label particles
WO2009001276A1 (en) 2007-06-25 2008-12-31 Koninklijke Philips Electronics N.V. Microelectronic sensor device for detecting label particles
US8160348B2 (en) 2007-08-06 2012-04-17 Historx, Inc. Methods and system for validating sample images for quantitative immunoassays
WO2009125339A2 (en) 2008-04-09 2009-10-15 Koninklijke Philips Electronics N. V. A carrier for optical detection in small sample volumes
DE102009003548A1 (en) 2009-02-27 2010-09-02 Leibniz-Institut für Analytische Wissenschaften-ISAS-e.V. Method for the high-resolution detection of nanoparticles on two-dimensional measuring surfaces
US20110311962A1 (en) 2009-02-27 2011-12-22 Alexander Zybin Method for high-resolution detection of nanoparticles on two-dimensional detector surfaces
WO2011027291A1 (en) 2009-09-07 2011-03-10 Koninklijke Philips Electronics N.V. Sensor cartridge with dissolvable cover layer
CN101655462A (en) 2009-09-11 2010-02-24 中国科学院地理科学与资源研究所 Apparatus for obtaining water quality information, method and system for recognizing water body eutrophication degree
US20120250005A1 (en) 2009-09-28 2012-10-04 Koninklijke Philips Electronics N.V. Biosensor system for single particle detection

Also Published As

Publication number Publication date
JP2014512546A (en) 2014-05-22
CN103620392B (en) 2017-05-17
US20140051187A1 (en) 2014-02-20
US10466163B2 (en) 2019-11-05
EP2702392A1 (en) 2014-03-05
JP6190358B2 (en) 2017-08-30
EP2702392B1 (en) 2019-10-30
US20200018689A1 (en) 2020-01-16
WO2012147021A1 (en) 2012-11-01
CN103620392A (en) 2014-03-05

Similar Documents

Publication Publication Date Title
US12392709B2 (en) Evaluating assays with optical inhomogeneities
US11016006B2 (en) System and method for real-time volume control
JP2010197367A (en) Detection apparatus for particle on glass and detection method using the same
JP2013531787A (en) Holographic fluctuation microscope apparatus and method for determining particle motility and / or cell dispersion
EP2181322A1 (en) Microelectronic sensor device for detecting label particles
CN103492859B (en) Substance determining apparatus
CN103620390B (en) Optical measurement device, optical measurement method, and optical measurement program
JP2001118899A (en) Foreign matter and pattern defect inspection equipment
US20100273269A1 (en) Method of measuring molecules in a fluid using label particles
JP6970112B2 (en) A method for inspecting distributed objects by segmenting an overview image
US11093583B2 (en) Method and system for improving the evaluation of an interaction between an analyte and a ligand using a biosensor
US12175654B2 (en) Surface inspection system and method for differentiating particulate contamination from defects on a surface of a specimen
CN118974561A (en) Biological sample measuring device
KR20200044172A (en) Deep learning method for analyzing defectiveness
JPS6349178B2 (en)
US20230384311A1 (en) Methods and related aspects for detecting unlabeled biomolecules
JP7034087B2 (en) Measuring equipment, measurement anomaly detection method, and program
JP2008261850A (en) Image inspection method for inspection plate
JP5160461B2 (en) Automatic analyzer
WO2015000720A1 (en) System for determining a quantitative number being indicative of the concentration of target elements in a fluid
KR20170079828A (en) Method of inspecting pattern defect

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: KONINKLIJKE PHILIPS N.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:EVERS, TOON HENDRIK;KLUNDER, DERK JAN WILFRED;NIEUWENHUIS, JEROEN HANS;AND OTHERS;SIGNING DATES FROM 20191210 TO 20200107;REEL/FRAME:051508/0986

AS Assignment

Owner name: SIEMENS HEALTHINEERS NEDERLAND B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KONINKLIJKE PHILIPS N.V.;REEL/FRAME:056547/0472

Effective date: 20201230

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE