[go: up one dir, main page]

CN1882031A - Method and equipment for forming multi-focusing images - Google Patents

Method and equipment for forming multi-focusing images Download PDF

Info

Publication number
CN1882031A
CN1882031A CN 200510125371 CN200510125371A CN1882031A CN 1882031 A CN1882031 A CN 1882031A CN 200510125371 CN200510125371 CN 200510125371 CN 200510125371 A CN200510125371 A CN 200510125371A CN 1882031 A CN1882031 A CN 1882031A
Authority
CN
China
Prior art keywords
focus
image
stack
array
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200510125371
Other languages
Chinese (zh)
Other versions
CN1882031B (en
Inventor
菲利普·M.·戈什
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FFEI Ltd
Original Assignee
FFEI Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP05253702.4A external-priority patent/EP1610166B1/en
Application filed by FFEI Ltd filed Critical FFEI Ltd
Publication of CN1882031A publication Critical patent/CN1882031A/en
Application granted granted Critical
Publication of CN1882031B publication Critical patent/CN1882031B/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

提供一种产生目标的多聚焦堆图像的方法。该堆图像具有目标的多个图像,每个图像具有对应的焦点范围或位置。该方法利用目标和光检测器阵列之间的相对扫描运动,扫描期间该阵列用于反复地接收来自目标作为扫描行的图像信息。扫描期间在各个图像的焦点范围或位置之间改变目标和该阵列间的相对聚焦,从而得到该堆中的各图像。从而每个图像是由在扫描期间从各个焦点范围或位置处得到的图像信息形成的。还提供完成该方法的设备。

A method of producing a multifocus stack image of an object is provided. The stack of images has multiple images of the target, each image having a corresponding focus range or position. The method utilizes relative scanning motion between a target and an array of photodetectors that is used to repeatedly receive image information from the target as scan lines during scanning. The relative focus between the object and the array is varied during scanning between the focal ranges or positions of the individual images to obtain each image in the stack. Each image is thus formed from image information obtained from various focus ranges or positions during scanning. Apparatus for carrying out the method is also provided.

Description

形成多聚焦堆图像的方法和设备Method and apparatus for forming multi-focus stack images

技术领域technical field

本发明涉及形成多聚焦堆图像的方法和设备。The present invention relates to methods and apparatus for forming multi-focus stack images.

背景技术Background technique

在一些诸如医学应用的市场领域中,利用显微镜检查样本并且利用附着在显微镜的二维数字相机生成数字图像。数字相机捕获的被观察的样本在面积上受到限制。对于40x的物镜,典型的面积仅为0.7mm宽。在显微镜载片上的有效面积给定为64×24mm情况下,可能的样本面积仅为非常小的面积。对此的一种办法是在整个样本面积上步进和重复,其还称为宏抖动。更优选的处理是利用类似于在US 6,711,283中公开的行扫描部件,其中可以收集0.7×64mm的长条数据。接着可以扫描相邻的带从而可以把图像接合或缝合在一起,如专利GB 2206011中说明那样。In some market areas such as medical applications, samples are examined using a microscope and a digital image is generated using a two-dimensional digital camera attached to the microscope. The observed sample captured by the digital camera is limited in area. For a 40x objective, the typical area is only 0.7mm wide. Given an active area of 64 x 24 mm on a microscope slide, the possible sample area is only a very small area. One approach to this is to step and repeat over the entire sample area, also known as macro dithering. A more preferred process is to use a line scanning unit similar to that disclosed in US 6,711,283, where 0.7 x 64 mm strips of data can be collected. Adjacent strips can then be scanned so that the images can be stitched or stitched together, as explained in patent GB 2206011.

如US 6,711,283中提到那样,长条扫描的一个问题是必须在整个扫描长度上保持聚焦。作为一个例子,对于数值孔径为0.65的40x透镜焦深约为1微米。典型的显微镜载片不是按保持这种类型的容限制造的,并且安装时可能由于安装方法或者在重力下弯曲超过1微米。而且要成像的样本本身不平直到1微米。在US 6,711,283中通过单独地在扫描长度建立聚焦图并且在扫描期间动态地调整聚焦以和该聚焦图配合解决该问题。遗憾的是,为每个样本建立聚焦图是耗时的。典型的聚焦方法是在不同的聚焦水平下扫描同一个区域然后利用评定算法确定最佳聚焦。存在若干已使用的评定算法,一个例子是取相邻象素间的差的平方和。这种评定算法产生例如图1中示出的函数,其中峰值(用箭头指示)看成是焦点。One problem with strip scanning, as mentioned in US 6,711,283, is that focus must be maintained throughout the scan length. As an example, the depth of focus for a 40x lens with a numerical aperture of 0.65 is approximately 1 micron. Typical microscope slides are not manufactured to maintain this type of tolerance and may warp by more than 1 micron when mounted due to the mounting method or under gravity. And the samples to be imaged themselves are not flat down to 1 micron. This problem is solved in US 6,711,283 by building a focus map at the scan length alone and dynamically adjusting the focus during the scan to work with this focus map. Unfortunately, building a focus map for each sample is time consuming. A typical focusing method is to scan the same area at different focus levels and then use an evaluation algorithm to determine the best focus. There are several evaluation algorithms that have been used, one example is taking the sum of squares of the differences between adjacent pixels. This scoring algorithm yields a function such as that shown in Figure 1, where peaks (indicated by arrows) are considered focal points.

用来解决该问题的另一种方法是得到多个聚焦水平不同的扫描。这称为聚焦堆或Z堆并在图2中示出。其思想是,在任何时刻至少聚焦扫描图像中的一个并且晚些时候可以组合Z图像堆400以给出单个聚焦图像。可以从一些供应商得到组合图像的软件。该方法的问题,对于样本聚焦变化范围内的小焦深,许多图像层需要覆盖完整的聚焦范围并且这会是耗时的。最佳聚焦线示在401上。在不同的位置402上堆中的图像只提供很少的有用信息。Another way to solve this problem is to get multiple scans with different levels of focus. This is called the focus stack or Z-stack and is shown in Figure 2. The idea is that at any time at least one of the scanned images is in focus and that the Z-stack 400 of images can be combined later to give a single in-focus image. Software to combine images is available from several suppliers. The problem with this approach is that for small depths of focus over the sample focus variation, many image layers need to cover the complete focus range and this can be time consuming. The line of best focus is shown on 401 . The images in the stack at different locations 402 provide little useful information.

从而需要解决这些缺点。There is thus a need to address these disadvantages.

发明内容Contents of the invention

依据本发明的第一方面我们提供一种产生目标的多聚焦堆图像的方法,谊堆图像包括该目标的多个图像,每个图像具有对应的焦点范围或位置,谊方法包括:According to a first aspect of the present invention we provide a method of generating a multi-focus stack image of an object, the stack image comprising a plurality of images of the object, each image having a corresponding focal range or position, the method comprising:

造成目标和光检测器阵列之间的相对扫描运动,该阵列用于在以扫描行的形式扫描期间从谊目标反复接收图像信息;以及causing relative scanning motion between the target and the photodetector array for repeatedly receiving image information from the target during scanning in scan lines; and

扫描期间在各个图像的所述焦点范围或位置之间造成改变该目标和该阵列之间的相对聚焦,从而得到堆中的图像,其中每个图像是由在扫描期间从各个焦点范围或位置得到的图像信息形成的。causing changes in the relative focus between the target and the array between said focus ranges or positions of the individual images during the scan, resulting in images in the stack, wherein each image is obtained from each focus range or position during the scan The image information is formed.

从而本发明相当不同于现有技术方法。在现有方法中堆图像是按相继的图像帧得到的,而在本发明中通过扫描行得到图像。重要的是,扫描行是扫描期间反复在图像的不同焦点位置(固定的或在一范围内的)之间交换的情况下得到的,并且然后利用这些扫描行在扫描结束时形成该堆中的不同聚焦的图像。这些图像可以被想成是聚焦水平或聚焦层。在讨论扫描时,应理解在具有多于一行的检测器的阵列下该术语包含若干检测器行的输出。但是,扫描行上的检测器的数量在数量级大于这种阵列的小数量(约小于16)。The present invention thus differs considerably from prior art methods. In the existing method, stack images are obtained in successive image frames, but in the present invention images are obtained by scanning lines. Importantly, the scanlines are obtained by repeatedly swapping between different focus positions of the image (fixed or within a range) during the scan, and are then used to form the stack at the end of the scan. Images with different focus. These images can be thought of as focus levels or focus layers. When discussing scanning, it is understood that under arrays with more than one row of detectors the term encompasses the output of several detector rows. However, the number of detectors on a scan line is orders of magnitude larger than the small number (approximately less than 16) of such an array.

从而本发明在可以使用相对便宜的设备的情况下明显优于现有技术。它还避免需要多次扫描目标,多次扫描会在记录得到的信息上造成问题。另外不需要用于事先产生聚焦图的辅助设备。它还允许在短时间内以及不需要以后的扫描情况下对非常局部的区域得到不同聚焦的图像信息。这有助于确保在任何介入阶段光学设备或样本中不发生变化并且能对扫描中带有明显构形的目标提供聚焦水平的在线改变。The present invention thus has significant advantages over the prior art in that relatively inexpensive equipment can be used. It also avoids the need to scan the target multiple times, which can cause problems in recording the resulting information. In addition, no auxiliary equipment is required for generating the focus map beforehand. It also allows differentially focused image information to be obtained for very localized areas in a short period of time and without the need for subsequent scanning. This helps to ensure that no changes occur in the optics or sample at any stage of the intervention and can provide an on-line change in focus level for objects with significant configuration in the scan.

典型地对目标的若干地带重复该方法并且在对目标的单次扫描中得到多聚焦堆图像。最好,在为堆中的某特定图像从目标得到图像信息的扫描行后修改相对聚焦,从而在为所述特定图像再次得到其它扫描行(图像信息)之前为至少一个其它图像得到该扫描行。从而在扫描期间可以在图像之间循环聚焦,以从各条扫描行构建这些图像。可以为每幅图像得到目标的公共区或部分的图像信息,而且可以在扫描期间暂停相对运动达到这一点。替代地,扫描运动可以基本是连续的,接着可以内插对每幅图像得到的图像信息从而形成该堆内的具有不同聚焦位置或范围的对应图像。The method is typically repeated for several regions of the target and a multifocus stack image is obtained in a single scan of the target. Preferably, the relative focus is modified after a scanline of image information has been obtained from the target for a particular image in the stack, such that the scanline is obtained for at least one other image before another scanline (image information) is obtained again for said particular image . Focusing can thus be cycled between images during scanning to construct these images from the individual scan lines. Image information of a common area or portion of the target can be obtained for each image, and this can be achieved by suspending relative motion during the scan. Alternatively, the scanning motion may be substantially continuous, and the image information obtained for each image may then be interpolated to form corresponding images within the stack with different focus positions or ranges.

该阵列可以是定义第一方向的一维阵列,并且相对扫描运动处于大致垂直于该第一方向的方向上。聚焦位置或范围彼此可以在聚焦上均匀或不均匀地隔开。聚焦范围包括处于限定该范围的二个外聚焦位置之间的聚焦区。当使用聚焦范围时,对于堆中的不同图像聚焦范围可以重叠或不重叠。当使用聚焦范围时,该方法可以包括在扫描期间利用来自扫描行的图像信息从而修改聚焦以当扫描继续进行时对每幅图像得到相继的扫描行。为此可以使用作为聚焦位置的函数的聚焦评定曲线,并且该方法则还可包括对堆中的图像控制聚焦从而对特定区覆盖“理想的”聚焦位置。可以把堆中的最中心图象(组)排列成和这些区中的理想聚焦位置相对应。The array may be a one-dimensional array defining a first direction, and the relative scanning motion is in a direction substantially perpendicular to the first direction. The focus positions or ranges may be evenly or non-uniformly spaced in focus from each other. The focus range includes a focus region between two out-of-focus positions defining the range. When using focus ranges, the focus ranges may or may not overlap for different images in the stack. When a focus range is used, the method may include using image information from scanlines during scanning to modify the focus to obtain successive scanlines for each image as scanning continues. A focus rating curve as a function of focus position may be used for this purpose, and the method may then further comprise controlling the focus on the images in the stack so as to cover an "ideal" focus position for a particular region. The centermost image (group) in the stack can be arranged to correspond to the ideal focus position in these regions.

可以利用堆中的各图像产生输出图像,这些输出图像具有根据构建其的图像的聚焦范围或位置的焦深。Each image in the stack can be utilized to generate an output image having a depth of focus according to the focal range or location of the image from which it was constructed.

谊阵列可以包括多个大致沿扫描方向排列在子阵列中的象素。它们可以大致沿扫描方向是隔开的并且每个子阵列适应接收对应颜色的光。The array may include a plurality of pixels arranged in sub-arrays generally along the scan direction. They may be spaced substantially along the scan direction and each sub-array adapted to receive light of a corresponding colour.

在一些例子中从相邻的区得到图像信息。当提供“m”个整数子阵列时,最好子阵列的间距按以区宽单位从阵列看到为mn-1,其中n是非零整数,典型地使不同时刻从不同区得到的图像信息相交织。In some instances image information is obtained from adjacent regions. When "m" integer sub-arrays are provided, it is preferable that the spacing of the sub-arrays is mn-1 seen from the array in units of area width, where n is a non-zero integer, typically to make the image information obtained from different areas at different times consistent. intertwined.

根据阵列的维数和定位确定相对运动的速度。Determines the speed of relative motion based on the dimensionality and orientation of the array.

依据本发明的第二方面我们提供一种用来产生目标的多聚焦堆图像的设备,该堆图像包括该目标的多个图像,多个图像具有对应的焦点范围或位置,该设备包括:According to a second aspect of the present invention we provide an apparatus for producing a multi-focus stack image of an object, the stack image comprising a plurality of images of the object with corresponding focus ranges or positions, the apparatus comprising:

光检测器阵列,用于以扫描行的形式接收来自图像的图像信息;an array of photodetectors for receiving image information from the image in scan lines;

扫描装置,用于提供谊阵列和目标之间的相对运动;a scanning device for providing relative motion between the array and the target;

聚焦装置,用于控制该阵列和目标之间的相对聚焦,以及focusing means for controlling the relative focus between the array and the target, and

控制系统,用于操作该扫描装置以造成目标和光检测器阵列之间的相对扫描运动;用于适应对该阵列进行控制以在扫描期间反复接收来自目标的图像信息;并且还用于操作该聚焦装置以在扫描期间在各个图像的所述焦点范围或位置之间造成目标和该阵列之间的相对聚焦的改变,从而得到堆中的各图像,其中每个图像是由在扫描期间各个焦点范围或位置处得到的图像信息形成的。a control system for operating the scanning device to cause relative scanning motion between the target and the photodetector array; for adapting control of the array to repeatedly receive image information from the target during scanning; and for operating the focusing means to cause a change in the relative focus between the target and the array during scanning between said focal ranges or positions of the individual images, whereby each image in the stack is obtained by a respective focal range during scanning Or the image information obtained at the position is formed.

该阵列可以包括排列在大致垂直于扫描方向的方向上的一维阵列或多个子阵列。象素的数量可以是大的,例如约为5000。可以提供子阵列的数量“m”,子阵列是隔开的从而从各区段中得到的对应图像信息在图像中大致沿扫描方向上的整数区段隔开。这种隔开可以是实际上的物理隔开或者等效地是光学隔开,例如通过使用分束器以及物理隔开的子阵列提供。The array may comprise a one-dimensional array or a plurality of sub-arrays arranged in a direction substantially perpendicular to the scan direction. The number of pixels can be large, for example about 5000. A number "m" of sub-arrays may be provided, the sub-arrays being spaced such that the corresponding image information derived from each segment is spaced in the image by approximately an integer number of segments in the scan direction. This separation may be actual physical separation or equivalently optical separation, for example provided by the use of beam splitters with physically separated sub-arrays.

对于彩色图像,最好子阵列各包括滤光器从而接收与一些特定颜色对应的光。聚焦部件可以通过移动该阵列或目标或者当其包括成像透镜通过移动成像透镜或成像透镜的组成部分实现聚焦。当聚焦部件包括叠镜时,聚焦部件通过移动叠镜实现聚焦。为此也可以使用光厚度可控的窗口,例如光电有源石英窗口或者带有作为转动角的函数的可变光厚度的可转动窗口。For color images, preferably the sub-arrays each include filters to receive light corresponding to some particular colour. The focusing component may achieve focusing by moving the array or target or, when it includes an imaging lens, by moving an imaging lens or components of an imaging lens. When the focusing component includes stacked mirrors, the focusing component achieves focusing by moving the stacked mirrors. It is also possible to use windows with controllable optical thickness for this purpose, for example optoelectronically active quartz windows or rotatable windows with variable optical thickness as a function of the rotation angle.

谊设备和方法可用于若干成像应用中,不过已发现在视场和场深典型地相当有效的显微镜中它是特别有好处的。The apparatus and method can be used in several imaging applications, but it has been found to be particularly beneficial in microscopes where the field of view and depth of field are typically quite efficient.

附图说明Description of drawings

现参照附图说明依据本发明的方法和设备的一些例子,附图中:Some examples according to the method and apparatus of the present invention are now described with reference to the accompanying drawings, in which:

图1示出技术上已知的聚焦评定曲线;Figure 1 shows a focus evaluation curve known in the art;

图2示出现有技术堆图像和理想聚焦;Figure 2 shows a prior art stack image and ideal focus;

图3是阵列扫描的示意透视图;Figure 3 is a schematic perspective view of array scanning;

图4示出扫描中扫描线的排列;Fig. 4 shows the arrangement of scanning lines in scanning;

图5示出带有“停止—启动”扫描的三聚焦堆积;Figure 5 shows trifocal stacking with a "stop-start" scan;

图5a示出一种特定的三聚焦堆方案;Figure 5a shows a specific three-focus stack scheme;

图6示出带有平滑扫描的三聚焦堆;Figure 6 shows a three-focus stack with smooth scan;

图7示出堆中不均匀间隔的图像;Figure 7 shows images of uneven spacing in the stack;

图8示出堆中的非平面的图像;Figure 8 shows a non-planar image in a stack;

图9示出扫描期间图像之间的不均匀间距;Figure 9 shows non-uniform spacing between images during scanning;

图10a示出下图像的交叉;Figure 10a shows the intersection of the lower image;

图10b示出上、下聚焦堆图像的交叉;Figure 10b shows the intersection of the upper and lower focus stack images;

图11示出聚焦跟踪期间焦点对准评定曲线;Figure 11 shows in-focus evaluation curves during focus tracking;

图12示出聚焦跟踪期间聚焦评定曲线的边缘;Figure 12 shows the edges of the focus rating curve during focus tracking;

图13示出跟踪聚焦的图像堆;Figure 13 shows an image stack for tracking focus;

图13a示出对该样本的堆;Figure 13a shows the stack for this sample;

图14示出该堆图像的焦点极端下的变化;Figure 14 shows the variation in focus extremes of the stack of images;

图15示出图14的二个位置上聚焦评定曲线;Figure 15 shows the focus evaluation curves at the two positions of Figure 14;

图16示出焦点对准下的三个外堆图像位置;Figure 16 shows the three outer stack image positions in focus;

图17示出三个位置,其中二个在聚焦的边缘上;Figure 17 shows three positions, two of which are on the edge of focus;

图18示出多行检测器阵列;Figure 18 shows a multi-row detector array;

图19a示出带有三个聚焦堆和平滑扫描的三个相邻的行检测器;Figure 19a shows three adjacent row detectors with three focus stacks and smooth scan;

图19b示出带有三个聚焦堆和平滑扫描的四个相邻的行检测器;Figure 19b shows four adjacent row detectors with three focus stacks and smooth scan;

图19c示出带有三个聚焦堆和平滑扫描的二个相邻的行检测器;Figure 19c shows two adjacent row detectors with three focus stacks and smooth scan;

图20示出隔开的三个行检测器阵列;Figure 20 shows three row detector arrays spaced apart;

图21a示出带有2行间距的3行检测器;Figure 21a shows a 3-row detector with a 2-row spacing;

图21b示出带有5行间距的3行检测器;Figure 21b shows a 3-row detector with a 5-row spacing;

图21c示出带有8行间距的3行检测器。Figure 21c shows a 3 row detector with 8 row spacing.

图22a示出带有2行间距、三聚焦堆以及光滑扫描的3行检测器;Figure 22a shows a 3-row detector with 2-row spacing, three focus stacks and smooth scan;

图22b示出带有5行间距、三聚焦堆以及光滑扫描的3行检测器;并且示出3个聚焦位置;Figure 22b shows a 3-line detector with 5-line spacing, three focus stacks, and smooth scan; and shows 3 focus positions;

图22c示出带有3行间距、三聚焦堆以及光滑扫描的4行检测器;Figure 22c shows a 4-row detector with 3-row spacing, three focus stacks and smooth scan;

图23示出带有缩窄线的不相邻行检测器;Figure 23 shows a non-adjacent row detector with narrowed lines;

图24示出用切换光扫描的RGB,并示出带有2行间距和3聚焦位置的3行检测器;Figure 24 shows RGB scanned with switched light and shows a 3 row detector with 2 row spacing and 3 focus positions;

图25a示出排列在彩色组中的多个检测器;Figure 25a shows multiple detectors arranged in color groups;

图25b示出排列在彩色序列中的多个检测器;Figure 25b shows multiple detectors arranged in a color sequence;

图26a示出含有二个分束器和三个阵列的设备;Figure 26a shows a device containing two beam splitters and three arrays;

图26b示出二个阵列、二个镜结构;Figure 26b shows two arrays, two mirror structures;

图26c示出三个阵列、二个镜结构;Figure 26c shows three arrays, two mirror structures;

图27a说明检测器头的移动;Figure 27a illustrates the movement of the detector head;

图27b说明成像透镜的移动;Figure 27b illustrates the movement of the imaging lens;

图27c说明可移动叠束镜的使用;Figure 27c illustrates the use of a movable beam stacker;

图27d说明样本的移动;Figure 27d illustrates movement of the sample;

图27e说明成像透镜内的移动件;Figure 27e illustrates moving parts within the imaging lens;

图27f示出可调光厚度的例子;Figure 27f shows an example of dimmable thickness;

图27g采用可变光厚度的转动窗口;以及Figure 27g employs a rotating window of variable optical thickness; and

图28示出可变光厚度的分布。Figure 28 shows the distribution of variable optical thickness.

具体实施方式Detailed ways

标准行扫描涉及单行x象素阵列,每个象素典型地对应该阵列中的一个检测器。对于彩色,对三个颜色中的每种颜色提供单个行(例如红绿蓝)。接着在垂直于检测器阵列行的方向上横移该单个行。把该横移速度置成在检测器的一次“行时间”后使检测器在扫描方向上横移一个象素的距离,从而下个行时间产生一条邻接前一个行的象素行。这在图3中示出,图中沿箭头指示的方向扫描1维阵列。Standard line scanning involves a single row x pixel array, each pixel typically corresponding to a detector in the array. For color, a single row is provided for each of the three colors (eg red green blue). The single row is then traversed in a direction perpendicular to the detector array rows. The traverse speed is set to traverse the detector a distance of one pixel in the scan direction after one "line time" of the detector so that the next line time produces a row of pixels adjacent to the previous row. This is illustrated in Figure 3, where the 1D array is scanned in the direction indicated by the arrow.

图4是从1维阵列的尾巴看到的1维阵列扫描的透视布局。横移方向用箭头表示,其中第一扫描行用“1”标记,第二行用“2”标记,并且依次类推。最简单的实施例是扫描并在移动到下个行期间把聚焦调整在不同的聚焦堆位置上。图5示出得到三个这样的堆的情况。这涉及停止—启动横移扫描,但不需要同一图像内的扫描行的内插。可以看出图5中用垂直箭头指示的聚焦方向大致在此情况中垂直于横移(扫描)方向。图5a更详细地示出该方案,其中线性阵列1具有进入该图的平面的方向。利用透镜达到聚焦变化。在15处示出带有可变厚度的样本,该样本定位在充当支承的载片上。用箭头X表示扫描行的位置,而扫描方向用Y示出。在此实施例中横移具有横移中的“停止—启动”动作,这并不总是希望的,因为停止和启动横移机构可能导致在图像中显示成跳动的位置误差。Figure 4 is a perspective layout of the 1D array scan seen from the tail of the 1D array. The direction of traverse is indicated by an arrow, where the first scan line is marked with a "1", the second line with a "2", and so on. The simplest embodiment is to scan and adjust the focus to a different focus stack position during the move to the next row. Figure 5 shows the situation where three such stacks are obtained. This involves a stop-start traverse scan, but does not require interpolation of scan lines within the same image. It can be seen that the focus direction indicated by the vertical arrows in Figure 5 is roughly in this case perpendicular to the traverse (scan) direction. Figure 5a shows this scheme in more detail, where the linear array 1 has an orientation into the plane of the figure. A lens is used to achieve focus variation. A sample with variable thickness is shown at 15 positioned on a slide acting as a support. The position of the scanning line is indicated by arrow X, while the scanning direction is shown by Y. In this embodiment the traversing has a "stop-start" action in the traversing, which is not always desirable because stopping and starting the traversing mechanism can cause position errors that show up as jerks in the image.

在另一实施例中可以把横移安排成是平滑的(固定的扫描速度),但其比图4慢三倍并且产生图6中所示的图像。接着如果需要的话可以使用内插方法以便利用相邻图像整治每个Z堆图像。尽管这些实施例示出三聚焦堆图像,最好能产生从2到任何实际数量的多聚焦堆图像。还不必必须使这些聚焦堆图像等距隔开,从而例如可能具有5个堆图像,其中包括三个中央堆和二个外围聚焦堆。这在图7中示出,其中行1和5和更接近间隔的行2、3和4更大地隔开。In another embodiment the traversing can be arranged to be smooth (fixed scan speed), but three times slower than in FIG. 4 and produce the image shown in FIG. 6 . Interpolation methods can then be used to clean each Z-stack image with neighboring images if desired. Although these examples show three focus stack images, preferably from 2 to any practical number of multi focus stack images can be produced. It is also not necessary to have the focused stack images equidistantly spaced, so that for example it is possible to have 5 stack images including three central stacks and two peripheral focused stacks. This is shown in Figure 7, where rows 1 and 5 and the more closely spaced rows 2, 3 and 4 are more spaced apart.

不需要把聚焦堆保持在固定平面中。这在图8中说明。可以在扫描期间跟随预定非平面投影的或者扫描期间通过反复确定最佳聚焦位置从而跟随样本中的非平面表面的堆图像获取系统中出现这样的情况。如图9中说明那样,堆内相邻图像中行间的间距不必是固定的。例如在图9中,该堆中的上、下图像展示不固定的间距,而在扫描中三个中央图像行具有固定的间距。There is no need to keep the focus stack in a fixed plane. This is illustrated in FIG. 8 . Such a situation may arise in a stack image acquisition system that follows a predetermined non-planar projection during scanning, or that follows a non-planar surface in a sample by iteratively determining the best focus position during scanning. As illustrated in Figure 9, the spacing between lines in adjacent images within a stack need not be constant. For example in Figure 9, the top and bottom images in the stack exhibit a variable spacing, while the three central image rows have a fixed spacing in the scan.

在一些情况中,如图10a、10b中示出那样,聚焦堆可以排列成彼此交叉。在图10a中,该堆中的最低图像在扫描期间和次低图像相交,而在图10b中,上、下图像和相邻的图像层相交,扫描开始时的次序是1、2、3、4、5而当扫描结束的次序变成2、1、3、5、4。In some cases, as shown in Figures 10a, 10b, focusing stacks may be arranged to cross each other. In Figure 10a, the lowest image in the stack intersects the next-lowest image during the scan, while in Figure 10b the upper and lower images intersect the adjacent image layers, and the order at the start of the scan is 1, 2, 3, 4, 5 and when the scan ends the order becomes 2, 1, 3, 5, 4.

一次取多个聚焦堆并且在扫描期间调整聚焦的一个具体优点是,有可能跟踪非平面体,例如组织样本或岩石样本的表面的聚焦,如果把二个外聚焦位置排列在聚焦曲线的斜坡上,有可能预测最佳聚焦位置并且调整聚焦位置从而把中央聚焦位置置在最佳聚焦位置上。这可以通过利用三个聚焦位置C、D、E借助图11中示出的聚焦评定曲线达到。在此方式下有可能通过查看检测器在所有三个位置上的相对评定值监视扫描器是否焦点对准。如果聚焦从聚焦位置上移动,则它会改变相对聚焦值如图12中所示。A particular advantage of taking multiple focus stacks at once and adjusting the focus during the scan is that it is possible to track the focus of the surface of a non-planar body, such as a tissue sample or a rock sample, if the two outer focus positions are aligned on the slope of the focus curve , it is possible to predict the best focus position and adjust the focus position to place the central focus position at the best focus position. This can be achieved by using the three focus positions C, D, E with the aid of the focus evaluation curve shown in FIG. 11 . In this way it is possible to monitor whether the scanner is in focus by looking at the relative ratings of the detector at all three positions. If the focus is moved from the focus position, it changes the relative focus value as shown in Figure 12.

比较图11和12可以看出,外聚焦位置(C和E)的相对评定值改变但中央聚焦位置(D)不必改变。如果扫描期间监视到此,则当此出现时可以调整聚焦以把聚焦位置(例如D)带回到聚焦范围的中央。这能减少需要扫描的聚焦堆的数量,因为如图13中所示不存在聚焦堆不接近图像聚焦的区域,在图13中示出堆图像300在扫描301期间跟随最佳聚焦线,它的大优点是由于不必扫描更多的其中许多图像只具有很少有用信息的堆图像而节约时间。通过扫描期间调整额定聚焦以跟随样本,从而会一次只给出较少的不同聚焦值。这更详细地在图13a中示出。Comparing Figures 11 and 12, it can be seen that the relative ratings for the outer focus positions (C and E) change but the center focus position (D) does not necessarily change. If this is monitored during scanning, the focus can be adjusted when this occurs to bring the focus position (eg D) back to the center of the focus range. This can reduce the number of focused stacks that need to be scanned because there are no areas where the focused stacks are not close to the image focus as shown in FIG. A big advantage is the time saved by not having to scan more piles of images, many of which have only little useful information. By adjusting the nominal focus during scanning to follow the sample, this will give fewer different focus values at a time. This is shown in more detail in Figure 13a.

可分离调整聚焦的措施能使扫描器在良好的聚焦值范围改变时把外聚焦水平置在聚焦边缘上。这在图14和15中示出,其中图15示出图14的扫描中二个位置A、B上的评定曲线。例如在细胞层的扫描中出现这种可变聚焦范围状态,在细胞层扫描的一些实施例中细胞在多层中堆在其它细胞的上面并且细胞层的数量在扫描中是变化的。图10和14中示出的在堆中的图像间改变间距的思想提供许多优点。许多现有方案不能提供这种功能。The provision for separately adjusting the focus enables the scanner to place the outer focus level on the edge of focus as the range of good focus values changes. This is shown in FIGS. 14 and 15 , where FIG. 15 shows the evaluation curves at two positions A, B in the scan of FIG. 14 . This variable focus range condition occurs, for example, in cell layer scans in which some embodiments cells are stacked on top of other cells in multiple layers and the number of cell layers varies during the scan. The idea of varying the spacing between images in a stack, shown in Figures 10 and 14, offers a number of advantages. Many existing solutions cannot provide this functionality.

另一实施例是把外聚焦图像排列在聚焦范围的边缘上但实际上不在焦点的外面。接着监视聚焦评定以保证所有的检测器都不在焦点之外。一旦一个外检测器显示达到焦点之外的评定值,调整聚焦以使所有的检测器回到焦点对准。图16示出三个焦点位置C、D、E(全都聚焦),而图17示出尽管位于聚焦边缘但仍聚焦的位置。这能使用户通过聚焦查看是否在比扫描器的聚焦范围大的焦深下扫描样本。还能利用软件借助一设备把这些图像组合成一个图像提高焦深。Another embodiment is to align the out-of-focus images on the edge of the focus range but not actually out of focus. The focus assessment is then monitored to ensure that all detectors are out of focus. Once an outer detector shows an out-of-focus rating, adjust the focus to bring all detectors back into focus. Fig. 16 shows three focus positions C, D, E (all in focus), while Fig. 17 shows a position which is in focus despite being on the edge of focus. This enables the user to focus to see if the sample is being scanned at a depth of focus greater than the scanner's focus range. It is also possible to use software to combine these images into one image with a device to increase the depth of focus.

尽管至今我们只说明使用1维阵列,能使用多个检测器以在提高生产率情况下完成该任务。如图18中所示,一实施例采用3乘x的象素阵列。按前面那样在锯齿式下移动聚焦,但横移速度要大n倍,其中n是行检测器阵列的数量。图19a、19b和19c示出分别带有用于3、4和2个行阵列的多聚焦位置的多个相邻行检测器。Although so far we have only illustrated the use of 1-dimensional arrays, multiple detectors can be used to accomplish this task with increased throughput. As shown in Figure 18, one embodiment employs a 3 by x pixel array. The focus is shifted in a sawtooth fashion as before, but with a traverse speed n times greater, where n is the number of row detector arrays. Figures 19a, 19b and 19c show multiple adjacent row detectors with multiple focus positions for 3, 4 and 2 row arrays respectively.

而且不要求该多个行检测器具有彼此相邻的行。从而能如图20中所示建立检测器间存在间隙的扫描过程。在此状态下在检测器的行间距关系上存在限制。对于整数扫描行间距,1维检测器数组间的间距必须为mn-1,其中m是1维检测器阵列的数量,而n是不等于零的整数(零情况和相邻行情况相同)。接着必须把扫描速度置成m。这给出图21a到21c以及图22a到22c示出的扫描图案。在图21a中列出的数字是1维检测器阵列的行号,从而此情况下行数为3,它们的间距为2(m=3,n=1)。对于图21b,行数=3,间距=5(m=3,n=2)。对于图21c,行数=3,间距=8(m=3,n=3)。在图22a中,行数=3,间距=2(m=3,n=1),并存在三个聚焦位置。在图22b中,行数=3,间距=5(m=3,n=2),并存在三个聚焦位置。在图22c中,行数=4,间距=4(m=4,n=1),并有三个聚焦位置。尽管可能不是总是要求检测器间具有整数行间距并且甚至如图23中所示希望用重叠的或者“缩窄”的行扫描,在图23中行数=3、间距=2.5、扫描行间距=2并有三个聚焦位置。Also it is not required that the plurality of row detectors have rows adjacent to each other. A scanning process with gaps between detectors can thus be established as shown in FIG. 20 . In this state there is a limit on the row spacing relationship of the detectors. For integer scan row spacing, the spacing between 1D detector arrays must be mn-1, where m is the number of 1D detector arrays and n is an integer not equal to zero (the zero case is the same as the adjacent row case). The scanning speed must then be set to m. This gives the scan patterns shown in Figures 21a to 21c and Figures 22a to 22c. The numbers listed in Fig. 21a are the row numbers of the 1-dimensional detector array, so that in this case the number of rows is 3 and their spacing is 2 (m=3, n=1). For Figure 21b, number of rows = 3, spacing = 5 (m = 3, n = 2). For Figure 21c, number of rows = 3, spacing = 8 (m = 3, n = 3). In Fig. 22a, the number of rows = 3, the pitch = 2 (m = 3, n = 1), and there are three focus positions. In Fig. 22b, the number of rows = 3, the pitch = 5 (m = 3, n = 2), and there are three focus positions. In Fig. 22c, number of rows = 4, pitch = 4 (m = 4, n = 1), and there are three focus positions. Although an integer line spacing between detectors may not always be required and may even be desirable to scan with overlapping or "narrowed" lines as shown in FIG. 2 and has three focus positions.

为了产生彩色图像或者多通道图像,能基于逐行地改变照明的颜色并且以通道数为因数减慢横移。例如如图24中所示对于红绿蓝三色扫描应要求为单色速度的三分之一的横移速度,在图24中利用切换光发生红绿蓝扫描,图中行数=3,间距=2(m=3,n=1)并有三个聚焦位置。To produce a color image or a multi-channel image, the color of the illumination can be changed on a line-by-line basis and the traverse slowed down by a factor of the number of channels. For example, as shown in Figure 24, for red, green and blue three-color scanning, it should be required to be a traversing speed of 1/3 of the monochromatic speed. In Figure 24, red, green and blue scanning is performed by switching light, and the number of rows in the figure=3, the spacing =2 (m=3, n=1) and there are three focus positions.

另一种产生红、绿、蓝彩色信息的方法是在检测器的各个行上放置红、绿、蓝滤光器。这种组合可以包括如图25a中所示把所有颜色相同的行组合在一起或者如图25b中所示把颜色序列组合在一起。重要的是要注意,如果不要求各带色行的重叠或缩窄,则和单色行间距那样应用“相同颜色行—相同颜色行”的间距限制。Another way to generate red, green, and blue color information is to place red, green, and blue filters on individual rows of detectors. Such combining may include combining all rows of the same color together as shown in Figure 25a or combining color sequences together as shown in Figure 25b. It is important to note that if overlapping or narrowing of the individual colored lines is not required, then the "same-colored-same-colored lines" spacing constraints apply as monochrome line spacing does.

在所有焦面数量小于所使用的1维阵列的数量的情况中,要求检测器检测光的时间短于移动到下个位置编号所需的时间以防止影象模糊。例如,对于带有单个焦面的四行检测器,光检测时间应短于运动时间的四分之一。不必必须具有图18、20和25a、25b中示出的单检测器系统。In all cases where the number of focal planes is less than the number of 1D arrays used, the time required for the detector to detect light is shorter than the time required to move to the next position number to prevent image blurring. For example, for a four-row detector with a single focal plane, the light detection time should be less than a quarter of the motion time. It is not necessary to have a single detector system as shown in Figures 18, 20 and 25a, 25b.

可以在如图26a至26c中示出的各种光重叠方法组合例如图3中示出的单行的检测器,以使检测器全都位于相同的焦面上。图26a示出使用含有二个分束器4、5和三个阵列1、2、3的设备。阵列1、3的虚象分别示在1’、3’。光轴示出在6处。检测器阵列的间距是二个扫描行(m=3,n=1)。图26b示出行间距2(m=3,n=1)下的双阵列和双镜7、8方案。阵列1和2和主射线分别在1”和2”处示出。图26c示出行间距8(m=3,n=3)下的三阵列1、2、3和双镜7、8系统。A single row of detectors such as that shown in Figure 3 can be combined in various light overlapping methods as shown in Figures 26a to 26c so that the detectors are all located on the same focal plane. Figure 26a shows the use of a device with two beam splitters 4,5 and three arrays 1,2,3. Virtual images of arrays 1, 3 are shown at 1', 3', respectively. The optical axis is shown at 6 . The pitch of the detector array is two scanning lines (m=3, n=1). Figure 26b shows a dual array and dual mirror 7, 8 scheme at a row spacing of 2 (m=3, n=1). Arrays 1 and 2 and chief rays are shown at 1" and 2", respectively. Fig. 26c shows a three-array 1, 2, 3 and two-mirror 7, 8 system at a row spacing of 8 (m=3, n=3).

如果布局置成不把检测器放在同一个平面中,则当扫描期间需要对相对焦面进行任何调整时,则检测器必须彼此相对移动并造成难以实现可变的不均匀焦面分离,或者大量的不均匀聚焦堆会需要大量的检测器以便同时扫描每个焦面。其它组合检测器的方法包括光纤束,物理上把检测器靠在一起以及排列在成像透镜上的微棱柱阵列。If the layout is arranged so that the detectors are not placed in the same plane, when any adjustments to the relative focal planes are required during scanning, the detectors must move relative to each other and make it difficult to achieve variable non-uniform focal plane separation, or A large number of non-uniform focus stacks would require a large number of detectors to scan each focal plane simultaneously. Other methods of combining detectors include fiber optic bundles, physically bringing the detectors together and arrays of microprisms arranged on imaging lenses.

存在若干在扫描期间调整聚焦的可能方法,其中一些在图27a至27g中示出。图27a示出包括带着3个阵列的双分束器系统的检测器头9的移动。在10上示出聚焦移动范围。图27b示出一种替代的例子,其中利用样本和检测器中间的成像透镜11的移动。图27c示出利用可移动的光束叠镜12、13、14达到聚焦。图27d示出如何通过移动样本15达到聚焦调制。图27e示出通过移动成像透镜11内的元件16达到聚焦改变。图27f示出替代设备,其中在样本侧设置厚度可调的窗口17,例如光电有源石英窗口。通过改变窗口的光厚度造成聚焦运动。图27g使用可变光厚度的转动窗口18。其中通过改变窗口的光厚度造成聚焦运动。该窗口具有绕其轴转动为函数(即沿圆周)改变光厚度和/或沿矢径方向改变光厚度的分布。这在图28中更详细地示出。There are several possible methods of adjusting focus during scanning, some of which are shown in Figures 27a to 27g. Figure 27a shows the movement of the detector head 9 comprising a double beam splitter system with 3 arrays. The range of focus movement is shown at 10 . Figure 27b shows an alternative example in which a movement of the imaging lens 11 between the sample and the detector is used. Figure 27c shows the use of movable beam stack mirrors 12, 13, 14 to achieve focus. Figure 27d shows how focus modulation is achieved by moving the sample 15. Figure 27e shows that focus changes are achieved by moving elements 16 within the imaging lens 11. Figure 27f shows an alternative device in which a window 17 of adjustable thickness is provided on the sample side, for example an optoelectronically active quartz window. Focusing motion is caused by changing the optical thickness of the window. Figure 27g uses a rotating window 18 of variable optical thickness. The focus movement is caused by changing the optical thickness of the window. The window has a profile that varies the optical thickness as a function of rotation about its axis (ie, along the circumference) and/or varies along the sagittal direction. This is shown in more detail in FIG. 28 .

本文说明的方案和现有技术相当不同,在现有技术中利用多个检测器通过每个检测器在不同的聚焦位置上捕获图像。相反,利用本发明在许多情况中我们可以使用单个检测器,例如如图3中所示。我们接着在逐行的基础上改变聚焦以形成多个聚焦值。这在图5至10中示出。我们还可以例如图18至25中那样采用多个检测器,但是任何时刻这些检测器处于相同的聚焦位置。The approach described here is quite different from the prior art in which multiple detectors are utilized with each detector capturing an image at a different focus position. Instead, with the present invention we can use a single detector in many cases, as shown for example in FIG. 3 . We then vary the focus on a line-by-line basis to form multiple focus values. This is shown in FIGS. 5 to 10 . We could also use multiple detectors eg as in Figures 18 to 25, but at any moment these detectors are in the same focal position.

概言之,从而提供一种行扫描方法以便一次产生多聚焦堆图像。1维(典型地)检测器数组在垂直于该阵列的轴的方向上横移并且通常处于检测器表面的平面中。对聚焦堆图像的每个图像调整扫描行之间的聚焦。当横移机构移动到第一聚焦堆图像的下个扫描行时循环地重复该过程,直至形成所有聚焦堆图像。In summary, a line scanning method is thus provided to generate multi-focus stack images in one pass. A 1-dimensional (typically) detector array is traversed in a direction perpendicular to the axis of the array and is usually in the plane of the detector surface. The focus between scanlines is adjusted for each image of the focus stack image. This process is repeated cyclically as the traverse mechanism moves to the next scan line of the first focus stack image until all focus stack images are formed.

检测器阵列典型地在垂直于谊阵列的轴的方向上(相对)横移并且通常在检测器表面平面中,横移速度取为使下一个行组为图像上的m行的整数倍。作为检测器的敏感区这些行不必必须尺寸相同。可以按彩色通道(若设置)的数量为因子减小相对于行的横移速度,并且在每次改变聚焦之前或期间对图像的每个通道改变照明颜色。The detector array is typically traversed (relatively) in a direction perpendicular to the axis of the array and typically in the plane of the detector surface, the traverse speed is taken such that the next group of rows is an integer multiple of m rows on the image. The rows do not necessarily have to be of the same size as the sensitive areas of the detectors. The traverse speed relative to rows can be reduced by a factor of the number of color channels (if set), and the illumination color is changed for each channel of the image before or during each change of focus.

扫描期间可有益地调整聚焦水平以便跟踪聚焦区。通过查看聚焦区两侧上至少两个水平下的聚焦评定函数的关系可以利用这些聚焦水平确定聚焦范围,其中这些水平置在该聚焦区的边缘上,例如保持焦点对准平面和焦面边缘之间的固定关系。The focus level can advantageously be adjusted during scanning in order to track the focal zone. Focus ranges can be determined using these focus levels by looking at the relationship of the focus rating function at at least two levels on either side of the focal zone, where these levels are placed on the edge of the focal zone, e.g., between the in-focus plane and the edge of the focal plane. fixed relationship between them.

在具体实施例中可以利用分束器/镜/微棱柱(成像透镜附近)以及阵列产生多个共焦线1维阵列。In a specific embodiment beam splitters/mirrors/microprisms (near the imaging lens) and arrays can be used to generate multiple confocal line 1D arrays.

Claims (38)

1.一种产生目标的多聚焦堆图像的方法,该堆图像包括该目标的多个图像,每个图像具有对应的焦点范围或位置,该方法包括:1. A method of producing a multi-focus stack image of an object, the stack image comprising a plurality of images of the object, each image having a corresponding focus range or position, the method comprising: 造成目标和光检测器阵列之间的相对扫描运动,该阵列用于在以扫描行的形式扫描期间从该目标反复接收图像信息;以及causing relative scanning motion between the object and the photodetector array for repeatedly receiving image information from the object during scanning in scan lines; and 在扫描期间在各个图像的所述焦点范围或位置之间造成要改变的该目标和该阵列之间的相对聚焦,从而得到该堆中的图像,其中每个图像是由在扫描期间在各个焦点范围或位置得到的图像信息形成的。The relative focus between the target and the array is caused to vary between said focal ranges or positions of the individual images during the scan, whereby the images in the stack are obtained, wherein each image is made of a The image information obtained by range or position is formed. 2.依据权利要求1的方法,其中对该目标的多个幅区重复该方法。2. The method according to claim 1, wherein the method is repeated for a plurality of swaths of the object. 3.依据权利要求1或2的方法,其中在对目标的单次扫描内得到该多聚焦堆图像。3. A method according to claim 1 or 2, wherein the multifocus stack image is obtained within a single scan of the object. 4.依据权利要求1至3中任一权利要求的方法,其中在为该堆中的一特定图像从该目标得到一条扫描行后,改变相对聚焦,从而在为所述特定图像得到另一扫描行之前为该堆中的至少另一个图像得到一扫描行。4. A method according to any one of claims 1 to 3, wherein after a scan line is obtained from the target for a particular image in the stack, the relative focus is changed such that after another scan line is obtained for said particular image A scan line is obtained for at least one other image in the stack before the line. 5.依据权利要求4的方法,其中在扫描期间,顺序地为每个图像得到扫描行从而在图像之间反复地循环聚焦。5. A method according to claim 4, wherein during scanning, scan lines are sequentially obtained for each image to cycle focus repeatedly between images. 6.依据权利要求5的方法,其中在每次循环期间暂停相对运动。6. A method according to claim 5, wherein the relative motion is suspended during each cycle. 7.依据权利要求1至5中任一项的方法,其中扫描运动大致是连续的。7. A method according to any one of claims 1 to 5, wherein the scanning motion is substantially continuous. 8.依据权利要求7的方法,还包括内插为每个图像得到的图像信息从而形成该堆中的具有不同聚焦位置或范围的对应图像。8. A method according to claim 7, further comprising interpolating the image information obtained for each image to form corresponding images in the stack having different focus positions or ranges. 9.依据上述任一权利要求的方法,其中该阵列是定义第一方向的一维阵列。9. A method according to any preceding claim, wherein the array is a one-dimensional array defining the first direction. 10.依据权利要求9的方法,其中该相对扫描运动大致垂直于该第一方向。10. The method according to claim 9, wherein the relative scanning motion is substantially perpendicular to the first direction. 11.依据上述任一权利要求的方法,其中聚焦位置或范围彼此焦点均匀间隔。11. A method according to any preceding claim, wherein the focal positions or ranges are focally evenly spaced from each other. 12.依据权利要求1至10中任一权利要求的方法,其中聚焦位置或范围彼此焦点不均匀地间隔。12. A method according to any one of claims 1 to 10, wherein the focus positions or ranges are focally non-uniformly spaced from each other. 13.依据权利要求12的方法,其中当采用聚焦范围时,各聚焦范围不重叠。13. A method according to claim 12, wherein when using focus ranges, the focus ranges do not overlap. 14.依据权利要求12的方法,其中当采用聚焦范围时,聚焦范围是重叠的。14. A method according to claim 12, wherein when using focus ranges, the focus ranges overlap. 15.依据上述任一权利要求的方法,还包括,当采用聚焦范围时,扫描期间利用图像信息以修改聚焦,以便为每个图像的各个区得到相继的图像信息。15. A method according to any preceding claim, further comprising, when using a focus range, using image information during scanning to modify the focus so that successive image information is obtained for each region of each image. 16.依据权利要求15的方法,还包括得到作为聚焦位置的函数的评定曲线。16. The method according to claim 15, further comprising obtaining a rating curve as a function of focus position. 17.依据权利要求16的方法,还包括对堆中的各图像控制聚焦从而对特定区覆盖理想聚焦位置。17. A method according to claim 16, further comprising controlling focus for each image in the stack so as to cover a desired focus position for a particular region. 18.依据权利要求17的方法,其中堆中最中央图像(组)的聚焦被设置为对应于这些区的理想聚焦位置。18. A method according to claim 17, wherein the focus of the most central image (group) in the stack is set to correspond to the ideal focus position of these regions. 19.依据上述任一权利要求的方法,还包括组合堆中的图像从而产生输出图像,该输出图像具有根据构建其的各图像的聚焦范围或位置的焦深。19. A method according to any preceding claim, further comprising combining the images in the stack to produce an output image having a depth of focus according to the focus range or position of the images from which it was constructed. 20.依据上述任一权利要求的方法,其中该阵列包括多个大致沿扫描方向排列在子阵列中的象素。20. A method according to any preceding claim, wherein the array comprises a plurality of pixels arranged in sub-arrays substantially along the scan direction. 21.依据权利要求20的方法,其中这些子阵列大致沿扫描方向是隔开的。21. A method according to claim 20, wherein the sub-arrays are spaced substantially along the scan direction. 22.依据权利要求21的方法,其中每个子阵列适于接收对应颜色的光。22. A method according to claim 21, wherein each sub-array is adapted to receive light of a corresponding colour. 23.依据权利要求22的方法,其中对每个图像从相邻的区得到图像信息并且其中提供m个子阵列,而且其中以区宽为单位从该阵列看到的子阵列间距为m×n-1,其中n为非零整数,从而交织不同时间得到的来自不同区段的图像信息。23. A method according to claim 22, wherein image information is obtained from adjacent regions for each image and wherein m subarrays are provided, and wherein the subarray spacing seen from the array in units of region width is m x n- 1, where n is a non-zero integer, thereby interleaving image information from different sections obtained at different times. 24.依据上述任一权利要求的方法,其中根据该阵列的维数和定位确定相对运动的速度。24. A method according to any preceding claim, wherein the velocity of the relative movement is determined from the dimensionality and orientation of the array. 25.一种用于产生目标的多聚焦堆图像的设备,该堆图像包括该目标的多个图像,每个图像具有对应的焦点范围或位置,该设备包括:25. An apparatus for producing a multi-focus stack image of an object, the image stack comprising a plurality of images of the object, each image having a corresponding focus range or position, the apparatus comprising: 光检测器阵列,用于以扫描行的形式接收来自目标的图像信息;an array of photodetectors for receiving image information from the target in scan lines; 扫描装置,用于提供该阵列和目标之间的相对运动;scanning means for providing relative motion between the array and the target; 聚焦装置,用于控制该阵列和目标之间的相对聚焦,以及focusing means for controlling the relative focus between the array and the target, and 控制系统,用于操作该扫描装置以造成目标和光检测器阵列之间的相对扫描运动;还适应于对该阵列进行控制以在扫描期间反复接收来自目标的图像信息;并且还用于操作该聚焦装置以在扫描期间在各个图像的所述焦点范围或位置之间造成目标和该阵列之间的相对聚焦的改变,从而得到堆中的各图像,其中每个图像是由在扫描期间各个焦点范围或位置处得到的图像信息形成的。a control system for operating the scanning device to cause relative scanning motion between the target and the photodetector array; further adapted to control the array to repeatedly receive image information from the target during scanning; and also for operating the focusing means to cause a change in the relative focus between the target and the array during scanning between said focal ranges or positions of individual images, whereby each image in the stack is obtained by a respective focal range during scanning Or the image information obtained at the position is formed. 26.依据权利要求25的设备,其中该阵列包括一维阵列。26. Apparatus according to claim 25, wherein the array comprises a one-dimensional array. 27.依据权利要求25或26的设备,其中该阵列包括多个排列在大致垂直于扫描方向的方向上的子阵列。27. Apparatus according to claim 25 or 26, wherein the array comprises a plurality of sub-arrays arranged in a direction substantially perpendicular to the scanning direction. 28.依据权利要求27的设备,其中提供并且隔开m个子阵列,从而从各区段中得到的对应图像信息在图像中大致沿扫描方向上的整数区段隔开。28. Apparatus according to claim 27, wherein m sub-arrays are provided and spaced such that corresponding image information derived from each sector is spaced in the image by substantially an integer number of sectors in the scan direction. 29.依据权利要求27或28的设备,其中子阵列各包括滤光器从而接收和特定颜色对应的光。29. Apparatus according to claim 27 or 28, wherein the sub-arrays each include a filter to receive light corresponding to a particular colour. 30.依据权利要求28或29的设备,还包括分束器从而提供依据权利要求28的子阵列的物理隔开以及子阵列的虚间隔。30. Apparatus according to claim 28 or 29, further comprising a beam splitter to provide the physical separation of the sub-arrays according to claim 28 and the imaginary spacing of the sub-arrays. 31.依据权利要求25至30中任一项的设备,其中该聚焦装置通过阵列的移动实现聚焦。31. Apparatus according to any one of claims 25 to 30, wherein the focusing means achieves focusing by movement of the array. 32.依据权利要求25至31中任一项的设备,还包括成像透镜并且其中该聚焦装置通过该成像透镜的或者成像透镜构件的移动实现聚焦。32. Apparatus according to any one of claims 25 to 31, further comprising an imaging lens and wherein the focusing means achieves focusing by movement of the imaging lens or imaging lens members. 33.依据权利要求25至32中任一项的设备,还包括叠镜并且其中该聚焦装置通过叠镜的移动实现聚焦。33. Apparatus according to any one of claims 25 to 32, further comprising a stack mirror and wherein the focusing means achieves focusing by movement of the stack mirror. 34.依据权利要求25至33中任一项的设备,其中该聚焦部件通过目标的移动实现聚焦。34. Apparatus according to any one of claims 25 to 33, wherein the focusing means achieves focusing by movement of the object. 35.依据权利要求25至32中任一项的设备,还包括光厚度可控的窗口,其中该聚焦装置通过操作该窗口实现聚焦。35. Apparatus according to any one of claims 25 to 32, further comprising a window of controllable optical thickness, wherein the focusing means operates the window to achieve focusing. 36.依据权利要求35的设备,其中该窗口由光电材料构成。36. Apparatus according to claim 35, wherein the window is formed of a photovoltaic material. 37.依据权利要求36的设备,其中该窗口可转动并且具有是转动角的函数的可变光厚度。37. Apparatus according to claim 36, wherein the window is rotatable and has a variable optical thickness as a function of the angle of rotation. 38.依据权利要求25至37中任一项的设备,其中该设备构成用于对显微目标成像的显微镜系统的一部分。38. Apparatus according to any one of claims 25 to 37, wherein the apparatus forms part of a microscope system for imaging microscopic objects.
CN 200510125371 2005-06-15 2005-11-16 Method and equipment for forming multi-focusing images Expired - Lifetime CN1882031B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05253702.4 2005-06-15
EP05253702.4A EP1610166B1 (en) 2004-06-24 2005-06-15 Method and apparatus for forming a multiple focus stack image

Publications (2)

Publication Number Publication Date
CN1882031A true CN1882031A (en) 2006-12-20
CN1882031B CN1882031B (en) 2013-03-20

Family

ID=37519988

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200510125371 Expired - Lifetime CN1882031B (en) 2005-06-15 2005-11-16 Method and equipment for forming multi-focusing images

Country Status (1)

Country Link
CN (1) CN1882031B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102818528A (en) * 2011-06-02 2012-12-12 先进科技新加坡有限公司 Apparatus and method for inspecting an object with increased depth of field
CN101482649B (en) * 2008-01-10 2013-06-05 奥林巴斯株式会社 Microscope apparatus
CN103765290A (en) * 2011-07-29 2014-04-30 Ffei公司 Method and apparatus for image scanning
CN105556240A (en) * 2013-08-01 2016-05-04 阿莱恩技术有限公司 Focal scanning for generating focused color images
CN108702455A (en) * 2016-02-22 2018-10-23 皇家飞利浦有限公司 Device for the synthesis 2D images with the enhancing depth of field for generating object
WO2022106810A1 (en) * 2020-11-17 2022-05-27 Ffei Limited Image scanning apparatus and method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6248988B1 (en) * 1998-05-05 2001-06-19 Kla-Tencor Corporation Conventional and confocal multi-spot scanning optical microscope
US6771283B2 (en) * 2000-04-26 2004-08-03 International Business Machines Corporation Method and system for accessing interactive multimedia information or services by touching highlighted items on physical documents

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI482996B (en) * 2008-01-10 2015-05-01 Olympus Corp The focus depth of the microscope device and the microscope device is enlarged
CN101482649B (en) * 2008-01-10 2013-06-05 奥林巴斯株式会社 Microscope apparatus
CN102818528A (en) * 2011-06-02 2012-12-12 先进科技新加坡有限公司 Apparatus and method for inspecting an object with increased depth of field
CN102818528B (en) * 2011-06-02 2015-04-15 先进科技新加坡有限公司 Apparatus and method for inspecting an object with increased depth of field
US9903785B2 (en) 2011-07-29 2018-02-27 Ffei Limited Method and apparatus for image scanning
US9638573B2 (en) 2011-07-29 2017-05-02 Ffei Limited Method and apparatus for image scanning
CN103765290B (en) * 2011-07-29 2017-08-01 Ffei公司 Method and device for image scanning
CN103765290A (en) * 2011-07-29 2014-04-30 Ffei公司 Method and apparatus for image scanning
CN105556240A (en) * 2013-08-01 2016-05-04 阿莱恩技术有限公司 Focal scanning for generating focused color images
US9956061B2 (en) 2013-08-01 2018-05-01 Align Technology, Inc. Methods and systems for generating color images
CN105556240B (en) * 2013-08-01 2018-08-28 阿莱恩技术有限公司 Focal length for generating focusing color image scans
US10363118B2 (en) 2013-08-01 2019-07-30 Align Technology, Inc. Methods and systems for generating color images
US10716647B2 (en) 2013-08-01 2020-07-21 Align Technology, Inc. Methods and systems for generating color images
US10874491B2 (en) 2013-08-01 2020-12-29 Align Technology, Inc. Methods and systems for generating color images of intraoral cavities
CN108702455A (en) * 2016-02-22 2018-10-23 皇家飞利浦有限公司 Device for the synthesis 2D images with the enhancing depth of field for generating object
WO2022106810A1 (en) * 2020-11-17 2022-05-27 Ffei Limited Image scanning apparatus and method

Also Published As

Publication number Publication date
CN1882031B (en) 2013-03-20

Similar Documents

Publication Publication Date Title
EP1610166B1 (en) Method and apparatus for forming a multiple focus stack image
JP6899963B2 (en) Real-time autofocus scanning
JP5829621B2 (en) Microscope sensor
CN1961255A (en) Array of micromirror array lenses
JP6940696B2 (en) Two-dimensional and three-dimensional fixed Z-scan
CN108845410B (en) Multi-beam confocal high-speed scanning imaging method and device based on polyhedral prism
JP7190034B2 (en) High-throughput optical tomography 3D imaging system
CN115061271A (en) Real-time automatic focusing algorithm
CN1882031A (en) Method and equipment for forming multi-focusing images
JP7235861B2 (en) High-throughput optical tomography imaging method and imaging system
CN113484939A (en) Wide-view-angle imaging method based on planar lens
JP6945737B2 (en) Dual processor image processing
JP7648605B2 (en) Sub-pixel Line Scanning
JP2011223233A (en) Line sensor camera and imaging device provided with the same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CX01 Expiry of patent term

Granted publication date: 20130320

CX01 Expiry of patent term