[go: up one dir, main page]

TW201736831A - System and method for inspecting containers using multile images of the containers - Google Patents

System and method for inspecting containers using multile images of the containers Download PDF

Info

Publication number
TW201736831A
TW201736831A TW105144108A TW105144108A TW201736831A TW 201736831 A TW201736831 A TW 201736831A TW 105144108 A TW105144108 A TW 105144108A TW 105144108 A TW105144108 A TW 105144108A TW 201736831 A TW201736831 A TW 201736831A
Authority
TW
Taiwan
Prior art keywords
light
container
bottle
camera
images
Prior art date
Application number
TW105144108A
Other languages
Chinese (zh)
Inventor
艾利克斯 哈德森
瑞濤 東
詹姆斯 陳
威爾 高瑞希
凱文 菲爾拜恩
Original Assignee
工業動力有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 工業動力有限公司 filed Critical 工業動力有限公司
Publication of TW201736831A publication Critical patent/TW201736831A/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • G01N21/9036Investigating the presence of flaws or contamination in a container or its contents using arrays of emitters or receivers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • G01N21/9018Dirt detection in containers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

A system and method for inspecting containers by detecting reflected light from defects are disclosed. A light source illuminates the contents of a container. One or more cameras are oriented to detect and the light reflected by one or more defects contained within the container, which are reflected from two or more mirrors towards the camera or cameras.

Description

利用各容器之複數影像以檢測容器之系統及方法 System and method for detecting containers using multiple images of each container

本發明大致上係關於瓶子和容器之檢測,尤其是關於牽涉使用光線以偵測瓶子或容器,以便指出瑕疵物或商品變異(commercial variations)者。 The present invention is generally directed to the detection of bottles and containers, and more particularly to the use of light to detect bottles or containers to indicate artifacts or commercial variations.

瓶裝飲料係每日生產、販售及消費的。由於此等飲料是屬於消費產品,因此受到嚴格的品質管制及檢測要求,且往往就直接在生產線上對容器執行檢測。生產程序包括了各樣功能,諸如洗瓶子、檢測瓶子之瑕疵物、將瓶子裝填如汽水或啤酒等飲料,封裝、及貼標籤於瓶子上。已經裝填之容器之品質檢測是發生在瓶子一前一後單排(single-file)行進中、在填料器(filler)出料時、或者是在貼標籤機之入料(in-feed)或出料(out-feed)時。 Bottled beverages are produced, sold and consumed daily. Since these beverages are consumer products, they are subject to strict quality control and testing requirements, and often perform inspections on containers directly on the production line. The production process includes functions such as washing the bottles, detecting the contents of the bottles, filling the bottles with beverages such as soda or beer, packaging, and labeling the bottles. The quality inspection of the filled containers occurs in the case of a single-file travel, in the case of a filler discharge, or in-feed or out of the labelling machine. When the material is out-feed.

解決對於小瑕疵物(例如1至3mm)檢測之節省成本方法一直都無法實現。玻璃碎片(fragments)以及其他物理性汙染物(physical contaminates)可能躺於一容器之基部而躲過了偵測。然而,無法偵測汙染物卻導致了昂貴的產品被召回並損及商譽。當今,儘管有許多檢測公司之廣泛發展方案(extensive development programs),卻只有少數的有效檢測解決方法可具體可靠地偵測例如小而任何形狀之物理性汙染物-現存之許多方法都遭遇到虛假的「通過」偵測(false“positive”detections),但此卻增加成本。 The cost-saving method for detecting small items (for example, 1 to 3 mm) has not been realized. Fragments and other physical contaminates may lie in the base of a container and escape detection. However, the inability to detect contaminants has resulted in expensive products being recalled and damaging goodwill. Today, despite the extensive development of many testing companies (extensive development) Programs, but there are only a few effective detection solutions that can reliably detect physical contaminants such as small and any shape - many of the existing methods encounter false "positive" detections (false "positive" detections). But this adds cost.

美國第專利7,982,868號專利係揭露一種使用兩個或更多不同定向(different orientations)之照相機以供偵測容器內異物(foreign substances)之方法與裝置,其中照相機與光源係相互連接,使得在短時間內一個充滿液體之容器之兩個或多個影像,可被以互相差異照明(mutually differing illumination)之方式被記錄。於此一專利中,可決定被檢測物質事實上代表所不要之異物(undesirable foreign substances)之或然率(probability)。換言之,將容器廢棄之決定是根據或然率之分佈(probability distributions)。在該專利中之方法與系統,可能導致瓶子之拖曳(drag),各個照相機在不同位置所拍攝之多數影像,需要高的數據速率(data rates)以及照相機影像速率(imaging rates)。 U.S. Patent No. 7,982,868 discloses a method and apparatus for detecting foreign substances in a container using two or more different orientations, wherein the camera and the light source are interconnected such that they are short Two or more images of a container filled with liquid can be recorded in a manner that is mutually differential illumination. In this patent, it is possible to determine the probability that the substance to be tested actually represents the undesirable foreign substances. In other words, the decision to discard the container is based on probability distributions. The methods and systems in this patent may result in dragging of the bottles, and most images taken by different cameras at different locations require high data rates and camera imaging rates.

為了檢測瓶子及容器總是需要改良之方法與系統,也是基於此種以及其他需求而指引本發明。 The present invention is also directed to such and other needs in order to inspect bottles and containers that always require improved methods and systems.

本發明敘述一種利用一光源(例如一定向之光線(directed light)、準直光線(collimated light)、或散射光線(scattered light))以偵測瑕疵物之瓶子或容器之檢測系統與方法,該光線經使用複數鏡片以反射,或使用鏡片以指引光線於瓶子或鏡片之軸線上,以抓取受到物理汙染物所反射或折射之光線。此處所敘述 之系統與方法可以提供一在比目前系統較小範圍(smaller footprint)之複數檢測功能之瓶子/容器檢測組件。 The present invention describes a detection system and method for detecting a bottle or container of a stolen object using a light source, such as directed light, collimated light, or scattered light. Light is reflected by the use of a plurality of lenses, or lenses are used to direct light onto the axis of the bottle or lens to capture light that is reflected or refracted by physical contaminants. Described here The system and method can provide a bottle/container detection assembly that performs multiple detection functions than the current system's smalller footprint.

本發明之一態樣係關於一可供檢測一瓶子或一容器之系統。該檢測構件包括一可產生一光源或光束之光源以及一照相機或多數照相機其可導引在瓶子內部之被一汙染物或瑕疵物(一通風管(vent tube)並非一碎片(fragment))所反射或折射之光線部份。 One aspect of the invention pertains to a system for detecting a bottle or a container. The detecting member includes a light source that generates a light source or a light beam and a camera or a plurality of cameras that can be guided inside the bottle by a contaminant or cockroach (a vent tube is not a fragment) The portion of the light that is reflected or refracted.

10‧‧‧照相機 10‧‧‧ camera

11‧‧‧照相機 11‧‧‧ camera

16‧‧‧鏡頭 16‧‧‧ lens

20‧‧‧鏡子 20‧‧‧Mirror

25‧‧‧鏡子 25‧‧‧Mirror

27‧‧‧光束分離器 27‧‧‧beam splitter

29‧‧‧鏡子 29‧‧‧Mirror

30‧‧‧圖像 30‧‧‧ Images

35‧‧‧圖像 35‧‧‧ Images

37‧‧‧圖像 37‧‧‧ Images

39‧‧‧圖像 39‧‧‧ Images

40‧‧‧孔隙板 40‧‧‧ aperture plate

45‧‧‧光源 45‧‧‧Light source

80‧‧‧帶子 80‧‧‧Band

85‧‧‧支撐板 85‧‧‧Support board

88‧‧‧輸送帶 88‧‧‧ conveyor belt

100‧‧‧檢測系統或組件 100‧‧‧Detection system or component

150‧‧‧鏡頭 150‧‧‧ lens

200‧‧‧瓶子 200‧‧‧ bottle

D‧‧‧距離 D‧‧‧Distance

F‧‧‧瑕疵物 F‧‧‧Shopping

圖1顯示本發明實施例在檢測容器期間之可供偵測汙染物之一檢測系統。 Figure 1 shows a detection system for detecting contaminants during detection of a container in accordance with an embodiment of the present invention.

圖2顯示本發明實施例位在一孔隙板上之光源上方之一瓶子。 Figure 2 shows a bottle above the light source on an aperture plate in accordance with an embodiment of the present invention.

圖3顯示本發明實施例檢測系統之側視圖,有一容器移動於檢測系統,並移至一輸送帶上。 Figure 3 shows a side view of a detection system in accordance with an embodiment of the present invention with a container moved to the inspection system and moved to a conveyor belt.

圖4顯示本發明實施例在檢測容器期間之可供偵測汙染物之一檢測系統。 Figure 4 shows a detection system for detecting contaminants during detection of a container in accordance with an embodiment of the present invention.

圖5顯示本發明實施例在檢測容器期間之可供偵測汙染物之一檢測系統。 Figure 5 shows a detection system for detecting contaminants during detection of a container in accordance with an embodiment of the present invention.

圖6顯示本發明實施例汙染偵測有效性反應曲線(contamination detection effectiveness response curve)。 FIG. 6 shows a pollution detection effectiveness response curve according to an embodiment of the present invention.

圖7顯示本發明實施例之相同瓶子以不同角度所拍攝之兩個 影像。 Figure 7 shows two of the same bottles taken at different angles in an embodiment of the invention. image.

圖8顯示本發明實施例由校正映射轉換(calibration map transformation)所產生之映射影像(mapped image)。 FIG. 8 shows a mapped image generated by a calibration map transformation according to an embodiment of the present invention.

圖9顯示本發明實施例之一處置線(transaction line)。 Figure 9 shows a transaction line in accordance with one embodiment of the present invention.

圖10顯示本發明實施例之一關注區域(region of interest)。 Figure 10 shows a region of interest for an embodiment of the present invention.

圖11顯示本發明實施例一處置線之邊緣。 Figure 11 shows the edge of a treatment line in accordance with an embodiment of the present invention.

圖12顯示本發明實施例一瓶子之圓柱形。 Figure 12 shows the cylindrical shape of a bottle of the embodiment of the present invention.

特定之實施例係有關可供偵測瓶子或容器內商品變異(commercial variations)或瑕疵物之系統與方法。舉例而言,瑕疵物可能為瓶子之填料器(filer)與封蓋器(crowner)之各個生產線位置上所產生之玻璃碎片(glass fragment)。該等蝦疵包括在填料過程中可能被引入之玻璃碎片,而可能落在瓶子基部之最低處。此等碎片可能無法反射或折射可供偵測之足夠光線。誤報功能(false alarm features)可能經由模具標記、美國資訊交換標準碼字體(ascii text)、以及其他壓花(embossing)、玻璃紋路(glass texture)、未連續之「笑臉」加工品(discontinuous‘smiley face’artifact)、水滴、外部之泡沫氣泡(exterior foam bubbles)、以及內部之玻璃夾雜物(interior glass inclusions)諸如由某些實施例可歸納出之泡沫或裂紋。誤報功能可發生於瓶子之外部或在容器壁內。瑕疵物或關注對象(object of interest)係位於瓶子內。 Particular embodiments are systems and methods for detecting commercial variations or stolen goods in bottles or containers. For example, the booty may be a glass fragment produced at various product line locations of the filer and the crowner of the bottle. These shrimp mites include glass shards that may be introduced during the filling process and may fall at the lowest point of the base of the bottle. These fragments may not reflect or refract enough light to detect. False alarm features may be via mold marking, ascii text, and other embossing, glass texture, discontinuous "smile" processing (discontinuous'smiley) Face'artifact), water droplets, exterior foam bubbles, and internal glass inclusions such as foams or cracks that can be generalized by certain embodiments. The false alarm function can occur outside the bottle or inside the container wall. The stolen object or object of interest is located inside the bottle.

詳細內容請參照圖式,圖1係描述一容器200在檢測期間可供偵測不可接受之商業異物或瑕疵物(unacceptable commercial variations or defects)之系統或檢測組件(inspection component)100,該容器200係由透明或部份透明之材料(例如玻璃)所構成。大致而言,該檢測系統或檢測組件100,經由各容器內之光線反射或折射,而足以偵測加工品或瑕疵物(例如沉澱物),能夠以三度空間影像辨別該沉澱物之位置,而降低瓶子外部或瓶子壁內經誤報之物。本文所稱「反射(reflection)」之用語,係包括了偵測作用下之光線反射(reflection)與折射(refraction)。照相機或感測器10係以可操作方式連接一處理器,其決定瓶子200內是否有瑕疵物。 For details, please refer to the drawings. FIG. 1 depicts a system or inspection component 100 for detecting unacceptable commercial variations or defects during inspection of a container 200. It consists of a transparent or partially transparent material such as glass. In general, the detection system or detection component 100 is reflective or refracting by light in each container, sufficient to detect a processed article or a sputum (eg, a sediment), and is capable of discriminating the location of the deposit in a three-dimensional image. Reduce the false alarms on the outside of the bottle or in the wall of the bottle. The term "reflection" as used herein refers to the reflection and refraction of light under detection. The camera or sensor 10 is operatively coupled to a processor that determines if there is any debris in the bottle 200.

如圖1所示,可供偵測瓶子200內瑕疵物之檢測系統或組件100具有一光源45、一照相機10、以及自一平台上有一或多個鏡子20、25。在一實施例中,該兩個鏡子20、25經置放以維持自物體至照相機在相同之路徑長度上。當該瓶子200並未含有瑕疵物時,由該光源45發射之光線係以實質尚未反射之方式通過該瓶子200。不過,當該瓶子200含有瑕疵物(例如一碎片)位於該光線30、35之路徑內時,該瑕疵物F反射至少一部份反射至鏡子20與鏡子25之光線,而由該照相機10所抓取及/或量測。在某些範例中,光線角度(自各鏡子20)係10至20度(自該瓶子200)。又在某些範例中,在容器200下方可以有一光源45,而在該容器200之基部與該光源45之間有一空隙。該照相機可包含一影像感測器或一使用機器 視覺(machine vision)或視覺軟體之處理器。大多數之容器或瓶子200在瓶子之壁部具有模具標記(mold marks),諸如模點(mold dots)、模具線條(mold lines)、以及字母數字標記(alpha numeric marks),其等可干擾瓶子內汙染物之成像。藉著結合瓶子200之這些不同之影像,即可藉由系統100之辨識出可能之瑕疵物之三度空間位置。相同物體或景像(scene)之複數影像,可用來計算出瑕疵物之三度空間形狀之呈現。 As shown in FIG. 1, the detection system or assembly 100 for detecting debris in the bottle 200 has a light source 45, a camera 10, and one or more mirrors 20, 25 from a platform. In one embodiment, the two mirrors 20, 25 are placed to maintain the same path length from the object to the camera. When the bottle 200 does not contain sputum, the light emitted by the light source 45 passes through the bottle 200 in a manner that is substantially unreflected. However, when the bottle 200 contains a smear (e.g., a shard) in the path of the ray 30, 35, the smear F reflects at least a portion of the light reflected by the camera 20 and the mirror 25 by the camera 10. Grab and/or measure. In some examples, the angle of light (from each mirror 20) is 10 to 20 degrees (from the bottle 200). In still other examples, there may be a light source 45 below the container 200 with a gap between the base of the container 200 and the light source 45. The camera can include an image sensor or a machine A processor of machine vision or visual software. Most containers or bottles 200 have mold marks on the wall of the bottle, such as mold dots, mold lines, and alpha numeric marks, which can interfere with the bottle. Imaging of internal contaminants. By combining these different images of the bottle 200, the third spatial position of the possible stolen goods can be identified by the system 100. A complex image of the same object or scene can be used to calculate the appearance of the three-dimensional shape of the object.

圖2顯示該系統100之一實施例,指出位於透過一孔隙板40之光源45(例如準直光線)上方之瓶子200。該準直光線係穿過該孔隙板40,而經由路徑30、35將瓶子200內之某些瑕疵物反射至鏡子20、25上而至照相機10之透鏡15上。該瓶子200可被固定(例如被帶子85所固定)於該孔隙板40上方一距離D處(亦如圖3所示)。 2 shows an embodiment of the system 100 indicating the bottle 200 located above the light source 45 (e.g., collimated light) that passes through an aperture plate 40. The collimated light passes through the aperture plate 40, and some of the contents of the bottle 200 are reflected onto the mirrors 20, 25 via the paths 30, 35 onto the lens 15 of the camera 10. The bottle 200 can be secured (e.g., secured by straps 85) at a distance D above the aperture plate 40 (also shown in Figure 3).

該從瓶子基部至該孔隙板40底緣之距離D,係視瓶子之物理上尺寸而定,而對於一個65mm直徑之瓶子而言,例如大約是0.5mm至2mm。孔隙之尺寸係重要的,大概是瓶子200之直徑之90%。此將促使容器之壁做為一光管(light pipe),照射任何在光線路徑上之物理上污染物(physical contaminate),而能夠使瓶子壁上之物理上裂痕(physical discontinuities),例如隨機模具標記(random mold marks)諸如點、字母數字標記(alpha numeric marks)、以及線條,其等可能混淆被用來檢測瓶子內汙染物之機器視覺演算(machine vision algorithms)。瓶子200之基部與孔隙板40之間之空 隙/距離D減少了由瓶子基部以及接觸之輸送表面所產生之鏡像加工物(mirroring artifacts)。再者,通常會使用水及清潔劑(detergents)做為瓶裝生產線輸送帶之潤滑,但其因泡沫或水滴的緣故而會引起假成像加工物(false imaging artifacts)。該空隙可促成使用氣刀(air knife)來乾燥瓶子之基部,以便改善汙染物檢測之容意度。此外,該空隙可防止瓶子基部之拖曳,因其可導致檢測期間瓶子之傾倒。 The distance D from the base of the bottle to the bottom edge of the aperture plate 40 depends on the physical size of the bottle, and for a bottle of 65 mm diameter, for example, is about 0.5 mm to 2 mm. The size of the pores is important, about 90% of the diameter of the bottle 200. This will cause the wall of the container to act as a light pipe, illuminating any physical contamination in the path of the light, and enabling physical discontinuities on the wall of the bottle, such as random molds. Random mold marks such as dots, alpha numeric marks, and lines, which may confuse machine vision algorithms used to detect contaminants in a bottle. The space between the base of the bottle 200 and the aperture plate 40 The gap/distance D reduces the mirroring artifacts produced by the base of the bottle and the conveying surface of the contact. Furthermore, water and detergents are often used as lubrication for the bottling line conveyor belt, but they can cause false imaging artifacts due to foam or water droplets. This void can contribute to the use of an air knife to dry the base of the bottle to improve the tolerance of contaminant detection. In addition, the void prevents dragging of the base of the bottle as it can cause the bottle to tip down during the test.

圖3顯示本發明系統100之側視圖,顯示該容器200移動經過該系統100並朝向該輸送帶88。在此範例中,移動中之帶子80係定位在該容器200之基部上方,以促使觀察到瓶子之基部相關範圍,如圖2所示之照相機圖像/光線路徑30與35交叉之態樣。該系統包括兩個順應之帶子(compliant belts)80,其等係受到一支撐板(backing plate)85所限制。該等移動之帶子80能夠在將各瓶子放回一輸送帶軌道88之前,拉動瓶子200經過該系統。在一替換之實施例(圖未示)中,係由一諸如夾鉗之機械裝置來抓住瓶子,並使用一諸如星形輪(starwheel)或線性機械人型態系統(linear robotic type system)之機械化運送系統。 3 shows a side view of the system 100 of the present invention showing the container 200 moving past the system 100 and toward the conveyor belt 88. In this example, the moving strap 80 is positioned over the base of the container 200 to facilitate viewing of the base-related extent of the bottle, as shown by the camera image/ray paths 30 and 35 as shown in FIG. The system includes two compliant belts 80 that are constrained by a backing plate 85. The moving straps 80 can pull the bottle 200 through the system before placing the bottles back into a conveyor track 88. In an alternative embodiment (not shown), the bottle is grasped by a mechanical device such as a clamp and a starwheel or linear robotic type system is used. Mechanized delivery system.

在一範例中,一玻璃容器檢驗電腦有一部分為一處理器,該玻璃容器檢驗電腦包括與該處理器聯結之記憶體,以及一或多個介面,該等界面係與該處理器聯結並與一或多個輸入裝置(諸如影像感測器、位置感測器、使用者介面等)以及/或一或多個輸出裝置(諸如光源、材料處理機、顯示器等)聯結者。該 電腦可進一步包括任何輔助裝置,諸如計時器、內部電源供應器,以及類似者等(圖未示)。該處理器可處理數據,並執行可提供本發明某些功能之指令。此處所使用之名詞「指令」可包括,例如控制邏輯、電腦軟體及/或韌體,可程式化指令、或其他適當之指令。記憶體可包括任何電腦可讀取之媒介、或者是各種媒介其等是安裝用來提供至少某些數據、數據結構、一操作系統、應用程式、程式模數(program modules)或數據、以及/或其他之電腦軟體或電腦可讀取之指令(該等指令可提供至少本發明之某些功能且可被該處理器所處理)之暫時儲存。該等數據、指令、以及類似者可被儲存為尋找表(look-up tables)、公式、演算法(algorithms)、地圖、模型、以及/或任何其他適當之格式。 In one example, a glass container inspection computer has a portion of a processor, the glass container inspection computer including a memory coupled to the processor, and one or more interfaces coupled to the processor and One or more input devices (such as image sensors, position sensors, user interfaces, etc.) and/or one or more output devices (such as light sources, material handlers, displays, etc.) are coupled. The The computer may further include any auxiliary devices such as a timer, an internal power supply, and the like (not shown). The processor can process the data and execute instructions that provide some of the functionality of the present invention. The term "instructions" as used herein may include, for example, control logic, computer software and/or firmware, stylized instructions, or other appropriate instructions. The memory can include any computer readable medium, or a variety of media that are installed to provide at least some data, data structures, an operating system, applications, program modules or data, and/or Or temporary storage of other computer software or computer readable instructions (which may provide at least some of the functionality of the present invention and which may be processed by the processor). The data, instructions, and the like may be stored as look-up tables, formulas, algorithms, maps, models, and/or any other suitable format.

圖4與圖5顯示本發明檢測系統100另外之實施例。圖4顯示一檢測系統100,其中光線45被反射至一照相機10,並使該照相機10所結合之鏡頭150安裝靠近瓶子200,俾產生一單一之影像,而其含有瓶子基部相關區域之兩個圖像30、35。該兩個圖像30、35係經由兩個鏡子20、25所獲得。而兩個鏡子20、25係經設置來產生瓶子內之汙染物或瑕疵物之角度補償影像。汙染物可與瓶子之加工物區隔,而加工物係存在於瓶子之外部,諸如模具刻痕及水滴。瑕疵物之實體鏡圖像(stereoscopic views)可經處理,以便決定是否為一種具商業上意義之瑕疵物(commercially significant defect)。 4 and 5 show additional embodiments of the detection system 100 of the present invention. 4 shows a detection system 100 in which light 45 is reflected to a camera 10 and the lens 150 to which the camera 10 is coupled is mounted adjacent to the bottle 200 to produce a single image containing two of the relevant areas of the base of the bottle. Images 30, 35. The two images 30, 35 are obtained via two mirrors 20, 25. The two mirrors 20, 25 are arranged to produce an angle compensated image of contaminants or artifacts within the bottle. Contaminants can be separated from the processing of the bottle, while the processed product is present outside the bottle, such as mold scores and water droplets. Stereoscopic views of the stolen goods can be processed to determine if it is a commercially significant likelihood.

圖4顯示另一照相機11與鏡頭16,係與一光束分離器(beam splitter)27搭配使用,以便經由瓶子200基部而抓取另外的 圖像/光線路徑。該檢測組件包括一經導引之光源(directed light source)其可射出光線,以及至少有兩個照相機10、11,經定位以偵測由瓶子之瑕疵物(諸如一碎片)所反射光線之一部份。此種設置容許額外地偵測某些型式之瑕疵物,其能夠產生由瓶子基部所見之較強之光線反射或陰影(若與圖像30、35所獲取之影像相較)。將圖像30、35、37結合,即可進一步增加該系統之偵測能力。一另外之實施例係使用一額外之閃光燈(strobe light),以側照(side light)瓶子200以及圖像37,以便比較瓶子內可能汙染之暗場影像(dark field image)。 Figure 4 shows another camera 11 and lens 16 for use with a beam splitter 27 to capture additional portions via the base of the bottle 200. Image/ray path. The detection assembly includes a directed light source that emits light, and at least two cameras 10, 11 positioned to detect one of the light reflected by the object of the bottle, such as a fragment. Share. This arrangement allows for additional detection of certain types of artifacts that are capable of producing a stronger reflection or shadow of light as seen by the base of the bottle (if compared to images acquired by images 30, 35). Combining the images 30, 35, 37 can further increase the detection capability of the system. In another embodiment, an additional strobe light is used to side light bottle 200 and image 37 to compare dark field images that may be contaminated within the bottle.

圖5顯示本發明系統100之另一實施例,該系統100具有一第三鏡子29,其係經引入定位在偏離鏡子20、25之軸線,以產生額外之各影像。圖像39內之資訊可用來與圖像/光線路徑30、35所產生之立體圖像(stereoscopic view)做比較,以便提供更多精確之瑕疵物偵測。該資訊可進一步提供受到偵測汙染物之尺寸與形狀。 Figure 5 shows another embodiment of the system 100 of the present invention having a third mirror 29 that is positioned to be offset from the axis of the mirrors 20, 25 to create additional images. The information in image 39 can be used to compare with the stereoscopic view produced by image/ray paths 30, 35 to provide more accurate artifact detection. This information can further provide the size and shape of the detected contaminants.

圖6表示舉例之汙染偵測效果反應曲線(contamination detection effectiveness response curve),其摘要出實驗結果,以決定呈現模具標記和模具線條(mold marks and lines)時取像汙染物瑕疵物之最佳角度。在淺角度(shallow angles)下,模具標記(點和字母數字標記)由於不太明顯故效果較小,不過模具線條則是非常清楚,使得整體之汙染物偵測率趨於緩和。在高取像角度上(其在汙染物或瑕疵物之成像是理想的),模具標記是非常明顯的,然 而模具線條則是非常不明顯。最佳視角因此被選定為大約20至25度,俾使任意之模具標記之效果最小,而鏡角差(mirror angle differential)大約為10度。 Figure 6 shows an example of a pollution detection effectiveness response curve, which summarizes the experimental results to determine the optimal angle for taking the pollutants and the like when presenting mold marks and lines. . At shallow angles, the mold marks (points and alphanumeric marks) are less effective because they are less noticeable, but the mold lines are very clear, making the overall contaminant detection rate tend to moderate. At high image angles (which are ideal for imaging contaminants or sputum), the mold marking is very noticeable, The mold line is very inconspicuous. The optimum viewing angle is therefore chosen to be approximately 20 to 25 degrees, minimizing the effect of any mold marking, with a mirror angle differential of approximately 10 degrees.

圖7顯示兩個同樣之景象或瓶子200取不同角度之影像,在此範例中,兩個在大約10度與20度之角度之影像被顯示在照相機框架(影像)中,經使用相同光源獲得且在相同時間取得(無相對運動)。成對之影像經結合並分析,以決定是否瓶子中含有瑕疵物。這個想法是要以一組鏡子、一組照相機、或是其等之組合,利用立體視覺(stereo vision),根據3D位置以及3D形態上屬性(morphological attributes),從其他瓶子之特徵及加工品,來區別瑕疵異物。照相機之空間位置與方向是經使用先前技藝之成像校準(imaging calibration)與擬合程序(fitting procedure)所決定的。就檢驗下之每一對目標物之影像而言,係操作目標物套合計算(object fitting algorithm),以便在兩個情境中識別及關聯目標物,並衍生出目標物之3D位置(例如使用習知技藝之校準模式)。舉例而言,一只玻璃杯之壁部可利用在瓶子跟部與壁部之半圓形加工品「笑臉加工品」曲率予以模擬(approximated)。此一加工品描述出每一成像之特有玻璃壁部之曲面。須重視注意到各個瓶子之尺寸是相異的-尤其是當經由不同之模具,且模具填裝入不同量之玻璃材料時,瓶子基部之厚度以及瓶子之直徑(呈橢圓形)。 Figure 7 shows two images of the same scene or bottle 200 taken at different angles. In this example, two images at angles of about 10 and 20 degrees are displayed in the camera frame (image) and obtained using the same light source. And at the same time (no relative motion). Paired images are combined and analyzed to determine if the bottle contains sputum. The idea is to use a set of mirrors, a set of cameras, or a combination of them, using stereo vision, based on 3D position and 3D morphological attributes, from other bottle features and processed products, To distinguish between foreign bodies. The spatial position and orientation of the camera is determined using prior art imaging calibration and fitting procedures. For the image of each pair of targets under test, the object fitting algorithm is manipulated to identify and correlate the target in two contexts and derive the 3D position of the target (eg, use The calibration mode of the prior art). For example, the wall portion of a glass can be mock-applied using the curvature of the semi-circular processed product "smile-finished product" at the heel and wall of the bottle. This processed product describes the curved surface of the unique glass wall of each image. It is important to note that the dimensions of the individual bottles are different - especially when passing through different molds and the mold is filled with different amounts of glass material, the thickness of the base of the bottle and the diameter of the bottle (elliptical).

較佳者為,使照相機、目標物、以及影像間之間隔最小於一大的孔隙,以便增加自碎片之反射照度之角度覆蓋。可 以使用個別獨立之兩個或更多個照相機,置於不同之角度,以形成影像,然而照相機及鏡頭之物理尺寸,可限制影像間之間隔角度或對立距離(standoff-distance),至比較佳者稍為大。一較小之角度(1至5度)顯示對於檢測之應用而言,有不足之深度解析度(depth resolution)。大的間隔(諸如在垂直平面上有25至30度)在目標物其中一圖像上會產生反射損失,而使得目標物擬合(object fitting)變得複雜。此一較佳之角度對某些實施例在水平面來說是不同的,而在光學照度上更為勻稱(symmetry)。此乃經由兩個間隔大約5及大約25度之照相機,產生3D重建(reconstructions),而初始研究者(initially investigated)。 Preferably, the spacing between the camera, the object, and the image is minimized to a large aperture to increase the angular coverage of the reflected illumination from the debris. can Two or more cameras that are independent of each other are placed at different angles to form an image. However, the physical size of the camera and lens can limit the angle of separation or standoff-distance between images. The one is slightly bigger. A smaller angle (1 to 5 degrees) indicates insufficient depth resolution for the application being tested. Large spacings (such as 25 to 30 degrees in a vertical plane) can cause reflection losses on one of the images of the target, making the object fitting complex. This preferred angle is different for some embodiments in the horizontal plane and more symmetry in optical illumination. This is done by two cameras spaced about 5 and about 25 degrees apart, resulting in 3D reconstructions, and initially investigated.

鏡頭之光學失真特性(optical distortion characteristics)經由計算予以補償,以及照相機之空間位置與方向亦同。一成像校準幻影(imaging calibration phantom)係置於檢測區域內,該幻影在已知位置具有各個高對比特徵(high-contrast features),其等係用來正確計算成像照相機相對於檢測目標物之位置與方向。此係用來做為參考數據,以便處理後續之影像以及產生3D數據。當照相機或鏡子被實際上移動過,計算可以重新做。 The optical distortion characteristics of the lens are compensated by calculation, and the spatial position and direction of the camera are also the same. An imaging calibration phantom is placed in the detection zone, the phantom having various high-contrast features at known locations, which are used to correctly calculate the position of the imaging camera relative to the detection target With direction. This is used as reference data to process subsequent images and generate 3D data. When the camera or mirror is actually moved, the calculation can be done again.

該檢測構件100可以包括兩個或更多鏡子,圖1係顯示有兩個鏡子,而兩個或更多鏡子或照相機可用來產生瓶子200之影像。 The detection member 100 can include two or more mirrors, and Figure 1 shows two mirrors, and two or more mirrors or cameras can be used to create an image of the bottle 200.

在又另一個實施例中,本發明技術之延伸,包括除了使用每一照相機之兩個景象之外,亦利用四個照相機之數據。 該四個照相機產生了來自不同且重疊之「笑臉」加工品,此將容許當比較僅有一個照相機時,有更加正確之瓶子壁面位置之產生。在水平面上之額外之鏡子能夠產生額外之實體鏡影像數據,而能夠用來改善3D之準確性。 In yet another embodiment, an extension of the present technology includes utilizing data from four cameras in addition to using two scenes per camera. The four cameras produce "smiley" finished products from different and overlapping, which will allow for a more accurate bottle wall position when comparing only one camera. Additional mirrors in the horizontal plane can generate additional solid mirror image data that can be used to improve 3D accuracy.

在又一實施例上,係使用兩個照相機,而非使用兩個鏡子及一照相機所產生之兩個影像。 In yet another embodiment, two cameras are used instead of two images produced by two mirrors and one camera.

在再一實施例中,本發明檢測構件100之最佳化者,可包含確定瓶子200之瑕疵物,係足以將至少光線之一部份反射於依照相機10上。因此,可使用多於一個之照相機10。如圖所示,此等照相機10可位於一瓶子200之單一平面,俾產生實體鏡圖像。該等照相機10在不離開本發明範圍的情況下,可相對於各個照相機10與該瓶子而定位於不同角度。 In still another embodiment, the optimizer of the sensing member 100 of the present invention can include determining the artifact of the bottle 200 sufficient to reflect at least a portion of the light onto the camera 10. Therefore, more than one camera 10 can be used. As shown, the cameras 10 can be positioned in a single plane of a bottle 200 to produce a solid mirror image. The cameras 10 can be positioned at different angles relative to the respective camera 10 and the bottle without departing from the scope of the present invention.

再者,照相機定位、照射、以及立體匹配(stereo match)可予以調整及最佳化。照相機定位(x、y、z)以及照相機鏡頭模式校準(lens model calibration)可經校準以便捕抓反射光線。光線照射位準(level)及方向可經調整以便產生一適當之訊號。例如,背光或側光(back-lit or side-lit)景象即為此一實施例之延伸。充分堅實且正確之立體匹配可產生改善之偵測,而且也容許虛假警報之辨別(discrimination of false alarms)。 Furthermore, camera positioning, illumination, and stereo match can be adjusted and optimized. Camera positioning (x, y, z) and camera lens calibration can be calibrated to capture reflected light. The level and direction of light illumination can be adjusted to produce an appropriate signal. For example, a back-lit or side-lit view is an extension of this embodiment. A sufficiently solid and correct stereo match can result in improved detection and also allows for discriminatory of false alarms.

在又一實施例中,該檢測構件100可包括各反射結構,其可反射並聚焦光線反射之部份,而光線之反射部份在到達照相機之前可結合兩個反射結構。該檢測構件亦可包括一個可運 送瓶子越過光源之裝置,其大約為300mm長度。此外,該檢測構件可具有一或多個照明源,其可為連續性、閃爍性、或其等之組合。再者,該檢測構件可包括各支撐帶,其等可引導瓶子進入一檢測位置。另外,該檢測構件可包括一輸送帶系統,其長度少於大約1,200mm。 In yet another embodiment, the sensing member 100 can include reflective structures that can reflect and focus portions of the light reflections, while the reflective portions of the light can combine the two reflective structures before reaching the camera. The detecting member may also include a transportable The device that delivers the bottle across the light source is approximately 300 mm in length. Additionally, the detection member can have one or more illumination sources, which can be continuous, scintillating, or a combination thereof. Furthermore, the detecting member can include support strips that can guide the bottle into a detection position. Additionally, the detection member can include a conveyor system having a length of less than about 1,200 mm.

額外之照相機可被定位於該檢測構件內,俾執行其他偵測,例如填充液位偵測(fill level detection)、漂浮標的物與下沉標地物偵測、以及泡沫偵測。在某些範例中,該檢測構件之照相機可自水平面偏移約20度或約10度,以及/或自光軸線約70或80度之偏移。而在另外之範例中,該檢測構件可自水平面偏離約10至約20度,以及自一光線軸偏移約70至約80度。該光線之直徑實質上相等於該瓶子之內徑。 Additional cameras can be positioned within the detection component to perform other detections such as fill level detection, floating target and sink target detection, and bubble detection. In some examples, the camera of the detection member can be offset from the horizontal by about 20 degrees or about 10 degrees, and/or offset from the optical axis by about 70 or 80 degrees. In yet another example, the sensing member can be offset from the horizontal by from about 10 to about 20 degrees and from about 70 to about 80 degrees from a ray axis. The diameter of the light is substantially equal to the inner diameter of the bottle.

在另一實施例中,該系統可使用經由利用一在瓶子輸送線上之位置觸發器(position trigger)以促使光源閃爍一短期間所獲致之影像,並以照相機抓取一單一影像。在某些範例上,照相機10具有一不高於每一秒鐘50幀照片之幀速率(frame rate),此乃針對典型之高速瓶子輸送線而言,其可降低整個系統之成本。 In another embodiment, the system can use an image obtained by utilizing a position trigger on the bottle transport line to cause the light source to blink for a short period of time and capture a single image with the camera. In some examples, camera 10 has a frame rate of no more than 50 frames per second, which is a typical high speed bottle conveyor that reduces the cost of the overall system.

固然本發明在最簡化之實施上可利用一個照相機,但是使用額外之照相機以及鏡組,則可涵蓋瓶子基部之相關較大範圍,而且就某些瓶子形式來說,亦可增加汙染物偵測之可靠度。一使用到兩個鏡子之替換的實施例是,利用兩個直接之景象照相機,其成本較高,但符合較高之數據處理需求。 Although the present invention can utilize a camera in the most simplified implementation, the use of additional cameras and mirrors can cover a relatively large range of bottle bases and, in some bottle formats, can also increase contaminant detection. Reliability. An alternative to the use of two mirrors is the use of two direct scene cameras, which are costly but meet the high data processing requirements.

本發明之一進一步實施例(參照圖1至5),係使用在一盤子40上之兩個或更多之準直光源45,具有相符於每一光源45而安裝之相對應額外之照相機10、鏡頭15、以及鏡子20、25,並搭配著移動兩個輸送帶80於不同速度,俾在瓶子移動越過該盤子40時,將瓶子轉動者,而瓶子在每一個光源45之定位是不同的,俾藉著各成像系統使得在瓶子內能有更多之檢測涵蓋區域。 A further embodiment of the invention (see Figures 1 to 5) uses two or more collimated light sources 45 on a plate 40 having corresponding additional cameras 10 mounted in accordance with each light source 45. , the lens 15, and the mirrors 20, 25, and in conjunction with moving the two conveyor belts 80 at different speeds, when the bottle moves over the plate 40, the bottle is rotated, and the positioning of the bottles at each of the light sources 45 is different. , through the various imaging systems, there are more detection coverage areas in the bottle.

本發明之再一實施例包括使用光線越過一瓶子,以便將汙染物(部份漂浮或完全漂浮),俾決定填充液位,並量測發泡度(degree of foaming)。 Still another embodiment of the invention includes the use of light over a bottle to conserve contaminants (partially floating or completely floating), determine the fill level, and measure the degree of foaming.

所稱之名詞「瓶子」或「容器」是包括透明或半透明之容器。在某些情況下,瓶子是有色瓶(tinted bottles),及或暗色液體(dark liquids),且照明光線之波長必需是光譜之近於紅外線部份。此外,極化光線(polarized light)可被用來偵測某些可見汙染物之型式,諸如玻璃紙(cellophane)或是用來處理非常反光的容器。 The term "bottle" or "container" is used to include a transparent or translucent container. In some cases, the bottles are tinted bottles, and or dark liquids, and the wavelength of the illumination must be near the infrared portion of the spectrum. In addition, polarized light can be used to detect patterns of certain visible contaminants, such as cellophane or to handle very reflective containers.

該檢測構件100可進一步包括各反射結構,其等可在光線反射部份自瓶子移動至一照相機時,將該光線反射部份反射並聚焦。該檢測構件亦包括各反射結構,其等係經定位以便在光線反射部份到達一照相機鏡頭前,將該光線反射部份反射並聚焦。如圖所示,該等反射結構係具有平面表面之平面結構。不過,以可利用其他幾何構形之結構而非平面表面(諸如凸面與凹面)之反射結構者。該等反射結構可經構形成為一雙影像鏡系統(dual image mirror system),其中每一光線反射部份再被一照相機測量之前,係結合兩個反射結構者。然而,在不離開本發明範疇之情況下,該光線在受到一照相機量測之前,係結合多於或少於兩個反射表面者。 The detecting member 100 may further include reflective structures that reflect and focus the light reflecting portion when the light reflecting portion moves from the bottle to a camera. The sensing member also includes reflective structures that are positioned to reflect and focus the reflected portion of the light before the reflected portion of the light reaches a camera lens. As shown, the reflective structures have a planar structure of planar surfaces. However, there are reflective structures that can utilize other geometric configurations rather than planar surfaces such as convex and concave surfaces. The reflective structures can be configured into a dual image mirror system (dual Image mirror system), where each light reflection portion is combined with two reflection structures before being measured by a camera. However, the light is combined with more or less than two reflective surfaces before being measured by a camera without departing from the scope of the invention.

於此揭露之檢測構件可進一步使用在其他應用上。照射一瓶子之基部容許填充液位檢測受到觀察。再者,該檢測構件可被進一步用來進行漂浮與下沉異物之檢測。 The detection member disclosed herein can be further used in other applications. Irradiation of the base of a bottle allows the filling level detection to be observed. Furthermore, the detecting member can be further used for detecting floating and sinking foreign matter.

本發明之一實施例包括檢測瓶子之方法。可供檢測在一部份透明之容器中商品變異之方法可包括,將容器輸送供檢測;將光線自該容器下方之光源導引朝向瓶子之相關範圍,使得當反射光線伸展於不同反射角度時,光線能夠反射該相關範圍;接受各反射光線,以便抓取該範圍之兩個實體鏡影像(stereoscopic images);以及藉著分析兩個實體鏡影像之光線圖案,以區別容器內之商品變異之不同型式。一輸送帶以及各支撐帶可移動瓶子/容器一接近或於一光源上方之一檢測位置。該光源可為雷射二極體(laser diodes)、或紅外線光源、或其他種形式之光源(諸如疝氣閃光燈(Xenon strobe)、石英鹵素燈(Quartz Halogen)、雷射光、可見光、紫外線光(UV)、以及紅外線光(IR))。利用一照相機,以使得在瓶子內之一瑕疵物所反射之光線部份被偵測出。可利用各電子感測器,而非使用各照相機,或者是各電子感測器與各照相機並用。光線可自瓶子基部朝著頸部傳送。 One embodiment of the invention includes a method of detecting a bottle. A method for detecting a variation in a product in a partially transparent container can include transporting the container for inspection; directing light from a source below the container toward a relevant range of the bottle such that when the reflected light extends at different angles of reflection Light can reflect the relevant range; receive each reflected light to capture two stereoscopic images of the range; and analyze the light patterns of the two solid mirror images to distinguish the variation of the product within the container Different types. A conveyor belt and each support belt move the bottle/container to a position close to or above one of the light sources. The light source can be a laser diode, or an infrared source, or other forms of light source (such as Xenon strobe, Quartz Halogen, laser, visible light, ultraviolet light (UV) ), and infrared light (IR)). A camera is utilized such that a portion of the light reflected by one of the objects in the bottle is detected. It is possible to use each of the electronic sensors instead of using each camera, or each electronic sensor is used in combination with each camera. Light can be transmitted from the base of the bottle towards the neck.

以上所述之各實施例利用一複雜之分佈式計算系統 (leverage a complex computing system),其包括了一可被用來建立並構形出此一檢測系統之人機介面(Human Machine Interface)、一可用來追蹤瓶子、照相機與閃光燈觸發以及退出控制之生產線控制模組(Line Control Module)、以及一視覺引擎(Vision Engine)做為支持影像所需之及時電腦圖像計算之執行。 The various embodiments described above utilize a complex distributed computing system (leverage a complex computing system), which includes a human machine interface that can be used to build and construct this detection system, a production line that can be used to track bottles, camera and flash triggers, and exit control. The Line Control Module and a Vision Engine are used to perform the timely computer image calculations required to support the image.

為了支持超過每分鐘1,500瓶子之及時(real-time)檢測需求,視覺引擎構件可經實現為及時、多線程軟體應用(multi-threaded software application)。本發明系統及時之態樣,是為了確定經檢測之瓶子,在瓶子到達其檢測區之千分之一秒內,歸類為瑕疵物或非瑕疵物之需要。該任意的多線程實現,經由促使被抓取瓶子之複數瓶子影像同時被處理,而促使了執行上之最佳化。此外,多線程動作可用來支持各種處理之流水性操作(pipelining),包括在目前瓶子之處理當下,下一瓶子之相片抓取(獲取影像)。固然多線程軟體基礎架構是此處所述本發明之系統與方法之重要元素,但是關鍵的還是用來同時處理各種影像之及時計算(real-time algorithms)。值得重視的是,此處所述之汙染物分析是脫離概率模式(probabilistic model),並朝向確定性模式(deterministic model)移動。在一概率模式之情形下,或然性(probability)是歸於受檢測之目標物,亦即或然性之分配決定一目標物是汙染物之或然性。此意謂著一可接受之目標物(亦即瓶子上之模具標記)或許被辨識為汙染物。再者,一汙染物也會被辨識為安全者。反之,一確定性模式則從一已知條件或初始狀態 產生相同輸出。換言之,縱然有相同之瓶子輸入影像以及軟體上有相同之靈敏度門檻設定(sensitivity threshold setting),各種計算總是產生相同結果。此一系統之優點在於,經過數千個已知好的跟壞的瓶子影像之離線清除(offline sweeps),軟體可經訓練,因而汙染物之呈現導至汙染物之正面的(positive)偵測/辨識。 To support real-time detection requirements of more than 1,500 bottles per minute, visual engine components can be implemented as timely, multi-threaded software applications. The timely manner of the system of the present invention is to determine the need for the tested bottle to be classified as a stolen or non-smoked product within a thousandth of a second of the bottle reaching its detection zone. This arbitrary multi-threaded implementation facilitates execution optimization by causing multiple bottle images of the captured bottle to be processed simultaneously. In addition, multi-threaded actions can be used to support pipelining of various processes, including photo capture (acquisition of images) of the next bottle under current bottle handling. While the multi-threaded software infrastructure is an important element of the systems and methods of the present invention described herein, it is critical to simultaneously process the real-time algorithms of the various images. It is worth noting that the contaminant analysis described here is a probabilistic model and moves towards a deterministic model. In the case of a probability mode, the probability is attributed to the object being tested, that is, the distribution of likelihood determines that the target is the probability of the contaminant. This means that an acceptable target (ie, the mold mark on the bottle) may be identified as a contaminant. Furthermore, a pollutant can also be identified as a safe person. Conversely, a deterministic pattern is from a known condition or initial state. Produce the same output. In other words, even with the same bottle input image and the same sensitivity threshold setting on the software, various calculations always produce the same result. The advantage of this system is that after thousands of known off-sweep bottle images are offline sweeps, the software can be trained so that the presence of contaminants leads to positive detection of contaminants. / Identification.

對於此檢測系統之多線程、確定性之基礎架構密切相關者係由各種線程(threads)所處理之數據關聯性。此等關聯性可用來區別瓶子內平躺之瑕疵物與各種瓶子外部特徵(exterior features)、水滴或灰塵。此外,只要任何檢測線程尋得一瓶內之瑕疵物,而藉著標註該瓶子為瑕疵品,則此等關聯性可用來使一已知之瓶子對於這些計算的操作時間變得最少。 The multi-threaded, deterministic infrastructure of this detection system is closely related to the data associations handled by various threads. These associations can be used to distinguish between lying objects in the bottle and various exterior features, water droplets or dust. In addition, as long as any detection thread finds a stolen item in a bottle and by labeling the bottle as a counterfeit, such association can be used to minimize the operating time of a known bottle for these calculations.

支持該應用之電腦視覺計算(computer vision algorithms)包括各個2D與3D計算之組合,其中各個2D計算被用來過濾各影像,使用這種技術包括但並不限於灰階(grayscale)、質地(texture)、以及像數濃度門檻(pixel concentration thresholding)。倘若此等低成本之2D計算結果無法絕對斷言瓶子之無瑕疵物,那麼將訴諸更廣泛之3D影像分類(triage of images)。所使用之2D計算之複雜度,可基於各種瓶子之形式以及其等之內容物而加以設定(configured)。 Computer vision algorithms that support this application include a combination of various 2D and 3D calculations, each of which is used to filter each image, including but not limited to grayscale, texture (texture) ), and pixel concentration thresholding. If such low-cost 2D calculations do not absolutely assert the innocence of the bottle, then a wider 3D image classification will be resorted to. The complexity of the 2D calculations used can be configured based on the form of the various bottles and their contents.

下列順序為可能之檢測計算之實現者: The following sequence is the implementer of the possible test calculations:

1.利用一校準靶(calibration target)來校準照相機,以估算照相機、鏡子、以及檢測站之相對定位。 1. Calibrate the camera with a calibration target to estimate the relative positioning of the camera, mirror, and inspection station.

2.從照相機抓取影像,並解析實體鏡影像。 2. Grab the image from the camera and parse the solid mirror image.

3.在實體鏡圖像中,應用校準地圖轉換(calibration map transformation)於兩者影像,以便獲致地圖影像。圖8。 3. In the solid mirror image, a calibration map transformation is applied to both images to obtain a map image. Figure 8.

4.在2D上,利用一介於光射出之孔隙與瓶子基部之間之缺口,以定義作用線(transaction line)910AKA「笑臉(smiley)」。此一笑臉定義瓶子之內基部。圖9。 4. On 2D, use a gap between the aperture of the light exiting the base of the bottle to define the action line 910 AKA "smiley". This smile defines the base inside the bottle. Figure 9.

5.尋找瓶子基部之輪廓,並定義相關區域(RO1)1010。圖10。 5. Find the outline of the base of the bottle and define the relevant area (RO1) 1010. Figure 10.

6.使用各種2D分割方法,以定義「笑臉」/作用線之各邊緣1110。圖11。 6. Use various 2D segmentation methods to define the edges 1110 of the "smiley face"/action line. Figure 11.

7.補償情節為作用線在影像中並未被全然表示。 7. The compensation plot is that the line of action is not fully represented in the image.

8.使用2D濾光器(filters)以便消除(smooth-out)該作用線。 8. Use 2D filters to smooth-out the line of action.

9.根據經修正的各笑臉,對每個圖像分配ROIs。 9. Assign ROIs to each image based on the corrected smiles.

10.對先前定義之ROI進行掃描,對潛在之瑕疵物使用各種2D分割技術(segmentation techniques)。假如無瑕疵物存在,則可宣告瓶子為「優良」瓶子,且計算可在此點中止。 10. Scan the previously defined ROI and use various 2D segmentation techniques for potential artifacts. If no sputum is present, the bottle can be declared a "good" bottle and the calculation can be aborted at this point.

11.根據上述之ROIs,利用雙目視差(binocular disparity)以產生瓶子之3D模式。 11. According to the ROIs described above, binocular disparity is utilized to create a 3D mode of the bottle.

12.濾除(filter out)由液體內容物中之氣泡或小顆粒所產生之噪音。 12. Filter out noise generated by bubbles or small particles in the liquid contents.

13.使用3D座標點門檻(3D points thresholding),以決定瓶中潛在之瑕疵物,而如果沒有座標點違反所設定之各門檻,則瓶 子可被宣告為「優良」瓶子,則計算可在此點予以中止。 13. Use the 3D points thresholding to determine the potential stolen goods in the bottle, and if there are no coordinate points that violate the set threshold, then the bottle The child can be declared as a "good" bottle and the calculation can be aborted at this point.

14.再次地,作用線上之雙目視差資訊可被用來定義瓶子之圓柱構形,也因此可決定該等壁之內部及外部之3D座標點。圖12。 14. Again, the binocular disparity information on the line of action can be used to define the cylindrical configuration of the bottle, and thus the 3D coordinate points inside and outside of the walls. Figure 12.

15.位置、密度、輪廓、以及其他門檻特質(thresholder attributes)即可被用來宣告在瓶子內是否有任何瑕疵物。 15. Location, density, profile, and other threshold attributes can be used to declare if there are any stolen goods in the bottle.

固然本發明之內容及優點已被詳細敘述,可瞭解的是,在不脫離如附帶之申請專利範圍所界定之發明內容精神及範疇之情形下,於此會有各種的變更、替換、以及改變產生。此外,本發明之範疇並無意受限於本說明書所敘述之特定過程、機械、製造、物質組成、裝置、方法、以及步驟之態樣。習於本行業之一般人仕,從此處敘述之相對應態樣將可利用本發明來瞭解現存或將被開發之過程、機械、製造、物質組成、裝置、方法、或步驟,而可產生實質上之功能或達到實質上之結果者。因此,附帶之申請專利範圍有意包括在本發明範疇中之所有過程、機械、製造、物質組成、裝置、方法、或步驟。 While the contents and advantages of the present invention have been described in detail, it is understood that various changes, substitutions and changes may be made without departing from the spirit and scope of the invention as defined by the appended claims. produce. In addition, the scope of the invention is not intended to be limited to the particular procedures, machinery, manufacture, compositions, compositions, methods, and steps described herein. The person skilled in the art, from the corresponding aspects described herein, will be able to use the present invention to understand the processes, machines, manufactures, compositions, devices, methods, or steps that are present or to be developed. The function or the result of achieving substantial results. Accordingly, the scope of the appended claims is intended to cover all of the processes, machinery, manufacture, compositions, devices, methods, or steps in the scope of the invention.

10‧‧‧照相機 10‧‧‧ camera

20‧‧‧鏡子 20‧‧‧Mirror

25‧‧‧鏡子 25‧‧‧Mirror

30‧‧‧圖像 30‧‧‧ Images

35‧‧‧圖像 35‧‧‧ Images

45‧‧‧光源 45‧‧‧Light source

100‧‧‧檢測系統或組件 100‧‧‧Detection system or component

200‧‧‧瓶子或瓶子 200‧‧‧ bottles or bottles

F‧‧‧瑕疵物 F‧‧‧Shopping

Claims (23)

一種可供檢測一透明或半透明容器內商品變異(commercial variations)之系統,包含:a.一光源,可導引光線朝向該容器之相關範圍(region of interest),使得當反射光線延伸向不同之反射角度時,光線能夠反射該相關範圍,其中該光源係位於該容器下方;b.一照相機,可接收該反射光線,其中平行之各反射光線行進至該等光感測器之共同部份,而非平行之光線行進至該等光感測器之各不同部份;c.一第一鏡子,可反射該等反射光線至該照相機;以及d.一處理器,可自該照相機接收至少兩個影像,並能夠藉著分析光圖案(light pattern)而區分容器中商品變異間之不同型式。 A system for detecting commercial variations in a transparent or translucent container, comprising: a. a light source that directs light toward a region of interest of the container such that when the reflected light extends differently When the angle is reflected, the light can reflect the relevant range, wherein the light source is located below the container; b. a camera that can receive the reflected light, wherein the parallel reflected light travels to a common part of the light sensors The non-parallel rays travel to different portions of the light sensors; c. a first mirror that reflects the reflected light to the camera; and d. a processor that receives at least the camera Two images, and can distinguish between different types of commodity variations in the container by analyzing the light pattern. 如申請專利範圍第1項所述之系統,進一步包含一第二鏡子。 The system of claim 1, further comprising a second mirror. 如申請專利範圍第1項所述之系統,其中該光源為準直光線(collimated light)。 The system of claim 1, wherein the light source is collimated light. 如申請專利範圍第1項所述之系統,其中該光源為極化光線(polarized light)。 The system of claim 1, wherein the light source is a polarized light. 如申請專利範圍第1項所述之系統,其中該相關範圍是該容器之下半部(bottom half)或下三分之一部(bottom third)。 The system of claim 1, wherein the relevant range is a bottom half or a bottom third of the container. 如申請專利範圍第1項所述之系統,其中該第一鏡子與該第二鏡子產生之容器影像,不同於2度與45度之間。 The system of claim 1, wherein the image of the container produced by the first mirror and the second mirror is different from between 2 and 45 degrees. 如申請專利範圍第1項所述之系統,進一步包含一位於該光源上方之基部。 The system of claim 1, further comprising a base above the light source. 如申請專利範圍第1項所述之系統,其中該處理方式是確定性分析(deterministic analysis)。 The system of claim 1, wherein the processing method is deterministic analysis. 如申請專利範圍第1項所述之系統,其中該容器之底部與該基部之間存在一缺口。 The system of claim 1, wherein there is a gap between the bottom of the container and the base. 如申請專利範圍第1項所述之系統,進一步包含另一照相機。 The system of claim 1, further comprising another camera. 如申請專利範圍第1項所述之系統,其中每一分鐘有多於100個瓶子被該系統所檢測。 The system of claim 1, wherein more than 100 bottles per minute are detected by the system. 如申請專利範圍第1項所述之系統,其中基部軸線與第一鏡子軸線呈一大約為20至25度角。 The system of claim 1, wherein the base axis is at an angle of about 20 to 25 degrees from the first mirror axis. 如申請專利範圍第1項所述之系統,其中基部軸線與第二鏡子軸線呈一大約為10至30度角。 The system of claim 1, wherein the base axis and the second mirror axis are at an angle of about 10 to 30 degrees. 一種可供檢測一部分透明容器內商品變異之方法,包含:a.將容器輸送供檢測;b.將光線自該容器下方之光源導引朝向該容器之相關範圍,使得當反射光線伸展於不同反射角度時,光線能夠反射該相關範圍;c.接受各反射光線,以便抓取該範圍之兩個實體鏡影像(stereoscopic images);以及d.藉著分析該兩個實體鏡影像之光線圖案,以區別容器內之商品變異之不同型式。 A method for detecting a variation in a product in a portion of a transparent container, comprising: a. transporting the container for inspection; b. directing light from a source below the container toward a relevant range of the container such that when the reflected light extends across the different reflections At an angle, the light can reflect the relevant range; c. accept each reflected light to capture two stereoscopic images of the range; and d. by analyzing the light patterns of the two solid mirror images, Differentiate the different types of commodity variations in the container. 如申請專利範圍第14項所述之方法,進一步包含輸送該容器於一基部上方,而有一光源在該基部之下方。 The method of claim 14, further comprising transporting the container above a base and having a light source below the base. 如申請專利範圍第15項所述之方法,其中該光源為準直光線。 The method of claim 15, wherein the light source is a collimated light. 如申請專利範圍第16項所述之方法,其中係利用兩個置於不同角度之照相機,而可決定在每一個容器器之內部或外部是否有一異物(foreign substance)。 The method of claim 16, wherein two cameras placed at different angles are used to determine whether there is a foreign substance inside or outside each container. 如申請專利範圍第14項所述之方法,其中該分析方式是確定性分析。 The method of claim 14, wherein the method of analysis is a deterministic analysis. 如申請專利範圍第14項所述之方法,其中該範圍是該容器之下半部。 The method of claim 14, wherein the range is the lower half of the container. 如申請專利範圍第14項所述之方法,其中該分析方式是多線程法(multi-threading)。 The method of claim 14, wherein the analysis method is multi-threading. 如申請專利範圍第20項所述之方法,其中該多線程方法包含同時分析多個實體鏡影像,其中該多個實體鏡影像包括該兩個實體鏡影像。 The method of claim 20, wherein the multi-threading method comprises simultaneously analyzing a plurality of solid mirror images, wherein the plurality of solid mirror images comprise the two solid mirror images. 如申請專利範圍第14項所述之方法,其中該分析方法包含流水性操作方法(pipelining)。 The method of claim 14, wherein the analytical method comprises a pipelining process. 如申請專利範圍第22項所述之方法,其中該流水性操作方法包含同時自該兩個實體鏡影像分析光圖案(light pattern),而能獲取下一個容器之各實體鏡影像者。 The method of claim 22, wherein the flow-through operation method comprises simultaneously analyzing a light pattern from the two solid mirror images, and acquiring the solid mirror images of the next container.
TW105144108A 2015-12-31 2016-12-30 System and method for inspecting containers using multile images of the containers TW201736831A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US201562273644P 2015-12-31 2015-12-31

Publications (1)

Publication Number Publication Date
TW201736831A true TW201736831A (en) 2017-10-16

Family

ID=59225874

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105144108A TW201736831A (en) 2015-12-31 2016-12-30 System and method for inspecting containers using multile images of the containers

Country Status (2)

Country Link
TW (1) TW201736831A (en)
WO (1) WO2017117566A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6996736B2 (en) * 2017-09-19 2022-01-17 キリンテクノシステム株式会社 Foreign matter inspection device
WO2019164551A1 (en) * 2018-02-22 2019-08-29 Trelleborg Sealing Solutions Us, Inc. System and method for detecting a condition of a seal
CN109472787A (en) * 2018-11-08 2019-03-15 上海金啤包装检测科技有限公司 The detection method and equipment of bottle cap, production line, computer equipment, storage medium
CN109490314B (en) * 2018-11-22 2022-12-23 南通科技职业学院 An industrial machine vision system based on an improved sensor detection device
US11623344B2 (en) * 2019-10-11 2023-04-11 Agr International, Inc. System and method for autonomously defining regions of interest for a container
CN111721774B (en) * 2020-06-23 2025-07-01 湖南正中制药机械有限公司 A light inspection method for automatic light inspection machine
DE102020118470A1 (en) * 2020-07-13 2022-01-13 Krones Aktiengesellschaft Device and method for inspecting containers
CN113740989B (en) * 2021-09-15 2022-10-04 中南大学 Collimating lens automatic coupling packaging equipment
CN117571731B (en) * 2024-01-16 2024-04-16 山东鹰眼机械科技有限公司 Impurity detection method and system based on lamp inspection machine

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0711494B2 (en) * 1988-06-16 1995-02-08 松下電工株式会社 Inspection method for translucent containers
US5256871A (en) * 1992-12-22 1993-10-26 Emhart Glass Machinery Investments Inc. Machine for video inspection of glass containers with intersecting light beams
CA2228381A1 (en) * 1995-08-04 1997-02-20 Image Processing Systems, Inc. Bottle thread inspection system and method of operating same
FR2747211B1 (en) * 1996-04-04 1998-04-30 Saint Gobain Cinematique DEVICE FOR READING RELIEFS ON A TRANSPARENT CONTAINER
US5896195A (en) * 1997-05-15 1999-04-20 Owens-Brockway Glass Container Inc. Container sealing surface area inspection
JP2003045782A (en) * 2001-07-31 2003-02-14 Canon Inc Reflection type reduction projection optical system and exposure apparatus using the same
US20140324520A1 (en) * 2005-05-20 2014-10-30 Diakont Advanced Technologies, Inc. Method for deterministic safety analysis in non-stationary high risk system, control method and control system using thereof
DE102007052302B4 (en) * 2007-10-31 2009-09-03 Khs Ag Inspection device with roller lighting
CN102439708B (en) * 2009-02-06 2016-03-02 新加坡科技研究局 Method of inspecting bonding structure of substrate and bonding structure inspection apparatus

Also Published As

Publication number Publication date
WO2017117566A1 (en) 2017-07-06

Similar Documents

Publication Publication Date Title
TW201736831A (en) System and method for inspecting containers using multile images of the containers
US11049237B2 (en) Method and device for optical examination of transparent bodies
EP1779096B1 (en) Apparatus and method for checking of containers
US11828712B2 (en) System and method for inspecting containers using multiple radiation sources
US10262405B2 (en) Optical inspection method and optical inspection device for containers
US8254659B2 (en) Method and apparatus for visually inspecting an object
JP2008508513A5 (en)
RU2579635C1 (en) Method and device for inspecting empty bottles
HU224264B1 (en) Equipment and method for the optical inspection of transparent containers
TW201315992A (en) Method and apparatus for non-destructive detection - undissolved particles in a fluid
US20030142299A1 (en) Device and method for inspecting the transparent bottoms of bottles
CN106052792A (en) Method and device for detecting liquid level of PET bottle based on machine vision
EP3605010B1 (en) Method and device for detecting defects in the closure of encapsulated vials
US20170038308A1 (en) Apparatus and method for inspecting containers
US20220236193A1 (en) Method and device for optically inspecting containers
CN112697810B (en) Method and device for optical inspection of containers
WO1995022755A1 (en) Spectral detection of contaminants in containers
AU2016261369A1 (en) System and method for inspecting bottles and containers using light
US6246062B1 (en) Missing lens detection system and method
JP2005017004A (en) System for inspecting foreign matter in glass bottle
CN115461613A (en) Method and device for inspecting containers
JP2003315280A (en) Method and device for inspecting foreign matter
CN103703356B (en) The optical check of container
EP4242642A1 (en) Container examination apparatus
US12270767B2 (en) Method and device for optically testing hollow bodies