[go: up one dir, main page]

CN1126649C - Robot's visual sensor based on small-wave transform optics - Google Patents

Robot's visual sensor based on small-wave transform optics Download PDF

Info

Publication number
CN1126649C
CN1126649C CN 01109002 CN01109002A CN1126649C CN 1126649 C CN1126649 C CN 1126649C CN 01109002 CN01109002 CN 01109002 CN 01109002 A CN01109002 A CN 01109002A CN 1126649 C CN1126649 C CN 1126649C
Authority
CN
China
Prior art keywords
lens
liquid crystal
installing
robot
fourier lense
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 01109002
Other languages
Chinese (zh)
Other versions
CN1304822A (en
Inventor
岳宏
邓志鹏
史健儒
戴士杰
李慨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hebei University of Technology
Original Assignee
Hebei University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hebei University of Technology filed Critical Hebei University of Technology
Priority to CN 01109002 priority Critical patent/CN1126649C/en
Publication of CN1304822A publication Critical patent/CN1304822A/en
Application granted granted Critical
Publication of CN1126649C publication Critical patent/CN1126649C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)
  • Manipulator (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)

Abstract

一种基于小波变换光学实现机器人视觉传感器,其特征是,在壳体的立筒内自下而上固装着成象物镜、液晶光阀、偏振分光棱镜、准直透镜、扩束透镜、半导体激光器,液晶光阀在成象物镜的焦距处。壳体的斜筒内由里向外固装着两个傅里叶透镜、电寻址空间光调制器、CCD光电耦合器件,电寻址空间光调制器安装在两个傅里叶透镜的前、后焦平面处。本发明安装到机器人上可对目标进行识别,并实现自动跟踪,信息处理速度快,滤波性能好,重复精度高。

Figure 01109002

A robot vision sensor based on wavelet transform optics is characterized in that an imaging objective lens, a liquid crystal light valve, a polarization beam splitter prism, a collimator lens, a beam expander lens, and a semiconductor laser are fixed from bottom to top in the vertical tube of the housing , the liquid crystal light valve is at the focal length of the imaging objective lens. Two Fourier lenses, an electrical addressing spatial light modulator, and a CCD optoelectronic coupling device are fixed inside the inclined tube of the housing from the inside to the outside. The electrical addressing spatial light modulator is installed in front of the two Fourier lenses, back focal plane. The invention installed on the robot can identify the target and realize automatic tracking, has fast information processing speed, good filtering performance and high repetition accuracy.

Figure 01109002

Description

基于小波变换光学实现机器人视觉传感器Realization of robot vision sensor based on wavelet transform optics

本发明属于一种机器人视觉传感器,特别涉及一种基于小波变换光学实现机器人视觉传感器。The invention belongs to a robot vision sensor, in particular to a robot vision sensor based on wavelet transform optics.

小波变换作为一种可靠的信号处理方法,与传统的变换比较,具有很多优点。滤波性能好,消除多余噪声和干扰,提高信噪比、不存在截断误差,重复精度高及良好的数字数据序列重建特征等。目前,现有机器人视觉图象处理多是基于计算机并行处理软件实现的,通常需要价格昂贵的工作站。特别随着计算和处理信息量的增大,计算速度难以实现实际工程中实时性的要求。As a reliable signal processing method, wavelet transform has many advantages compared with traditional transform. Good filtering performance, eliminating redundant noise and interference, improving signal-to-noise ratio, no truncation error, high repeatability and good digital data sequence reconstruction characteristics, etc. At present, most of the existing robot vision image processing is realized based on computer parallel processing software, which usually requires expensive workstations. Especially with the increase of the amount of calculation and processing information, the calculation speed is difficult to meet the real-time requirements in actual engineering.

本发明基于小波变换光学实现机器人视觉传感器可以把光学信息处理系统和计算机结合起来,建立适合于视觉图象处理的各种小波基滤波函数库,提取最佳图象特征,并将视觉传感器获取的信号,直接读入计算机,进而控制机器人手臂实现自动跟踪运动。The present invention realizes robot visual sensor based on wavelet transform optics, can combine optical information processing system and computer, establish various wavelet base filtering function libraries suitable for visual image processing, extract the best image features, and obtain the visual sensor The signal is directly read into the computer, and then the robot arm is controlled to realize automatic tracking movement.

本发明的目的在于克服现有技术中的不足之处而提供一种基于小波变换光学实现机器人视觉传感器。The purpose of the present invention is to overcome the deficiencies in the prior art and provide a robot vision sensor based on wavelet transform optics.

本发明的技术解决方案如下:Technical solution of the present invention is as follows:

基于小波变换光学实现机器人视觉传感器的结构是,在壳体(7)的立筒内下端口处固装着成象物镜(1),成象物镜(1)的上方焦距处固装着液晶光阀(2),液晶光阀(2)的上方、壳体立筒和斜筒轴线的交汇处安装着偏振分光棱镜(3),偏振分光棱镜(3)的上方固装着准直透镜(4);在壳体(7)内的上端口处固装着半导体激光器(6),在半导体激光器(6)和准直透镜(5)之间固装着扩束透镜(5)。壳体(7)的斜筒内固装着傅里叶透镜(8)和傅里叶透镜(10),其位置要保证偏振分光棱镜(3)的读出光入射到傅里叶透镜(8)内,并使傅里叶透镜(8)的后焦平面与傅里叶透镜(10)前焦平面汇合在一处,且在此处安装着电寻址空间光调制器(9)。在傅里叶透镜(10)的右方斜筒内的端口处固装着CCD光电耦合器件(11)。成象物镜(1)、液晶光阀(2)、偏振分光棱镜(3)、扩束透镜(4)、准直透镜(5)、半导体激光器(6)在同一轴线上,偏振分光棱镜(3)、傅里叶透镜(8)、电寻址空间光调制器(9)、傅里叶透镜(10)和CCD光电耦合器件(11)在同一轴线上。电寻址空间光调制器(9)和CCD光电耦合器件(11)分别用电缆与计算机(12)相连接。Realizing the structure of the robot vision sensor based on wavelet transform optics is that an imaging objective lens (1) is fixed at the lower port in the vertical tube of the housing (7), and a liquid crystal light valve (1) is fixed at the focal length of the top of the imaging objective lens (1). 2), the top of the liquid crystal light valve (2), the intersection of the casing vertical cylinder and the axis of the inclined cylinder is installed with a polarization beam splitter prism (3), and a collimator lens (4) is fixed above the polarization beam splitter prism (3); A semiconductor laser (6) is fixed at the upper port in the casing (7), and a beam expander lens (5) is fixed between the semiconductor laser (6) and the collimating lens (5). A Fourier lens (8) and a Fourier lens (10) are fixed in the inclined cylinder of the casing (7), and its position should ensure that the readout light of the polarizing beam splitter prism (3) is incident on the Fourier lens (8). Inside, the rear focal plane of the Fourier lens (8) and the front focal plane of the Fourier lens (10) converge in one place, and an electrically addressable spatial light modulator (9) is installed here. A CCD photocoupling device (11) is fixedly installed at the port in the right oblique cylinder of the Fourier lens (10). Imaging objective lens (1), liquid crystal light valve (2), polarization beam splitter prism (3), beam expander lens (4), collimator lens (5), semiconductor laser (6) are on the same axis, polarization beam splitter prism (3 ), the Fourier lens (8), the electrical addressing spatial light modulator (9), the Fourier lens (10) and the CCD photoelectric coupling device (11) are on the same axis. The electrical addressing spatial light modulator (9) and the CCD photoelectric coupling device (11) are respectively connected with the computer (12) by cables.

液晶光阀2的分辨率为401p/mm,对比度为100∶1,写入时间为40ms。The resolution of the liquid crystal light valve 2 is 401p/mm, the contrast ratio is 100:1, and the writing time is 40ms.

偏振分光棱镜分光角为45-90度。The splitting angle of the polarizing beam splitting prism is 45-90 degrees.

半导体激光器6功率为5-15mW。The power of semiconductor laser 6 is 5-15mW.

电寻址空间光调制器9的象素数为800×600,画幅频率为200Hz,象元尺寸为33×33,填充因子为0.27,对比度为200∶1。The number of pixels of the electrical addressing spatial light modulator 9 is 800×600, the frame frequency is 200Hz, the pixel size is 33×33, the fill factor is 0.27, and the contrast ratio is 200:1.

CCD光电耦合器件11的型号为DH512-PRO。The model of the CCD photocoupler 11 is DH512-PRO.

基于小波变换光学实现机器人视觉传感器的工作原理如下:外界物体通过成象透镜(1)成象在液晶光阀(2)(LCLV-Liquid Crystal Light Valve)上,即光寻址空间光调制器上。半导体激光器(6)发出波长为635纳米的激光光束,经扩束透镜(5)和准直透镜(4)变为平行光照在偏振分光棱镜(3)上。偏振分光棱镜(3)将平行光偏振折射到液晶光阀(2)上。液晶光阀(2)的读出光沿原路返回,再通过偏振分光棱镜(3)入射到第一个傅里叶透镜(8)上。根据光学4f系统原理实现滤波,即将电寻址空间光调制器(9)放置在傅里叶透镜(8)的后焦平面上,由计算机控制输入的滤波函数频谱,在这里完成与图象读出光频谱相乘。因为电寻址空间光调制器(9)处于傅里叶透镜(10)的前焦平面上,傅里叶透镜(10)将光函数从频域转换至空间域,最后经过小波变换的物象光函数直接照射到CCD光电耦合器件(11)上。CCD光电耦合器件(11)与计算机(12)相通讯,这样,通过非相干光转换成相干光的处理,利用4f系统滤波原理和计算机(12)控制的电寻址空间光调制器(9),实现小波变换处理,其信号由CCD光电耦合器件(11)接收,并读入计算机(12)。The working principle of the robot vision sensor based on wavelet transform optics is as follows: the external object is imaged on the liquid crystal light valve (2) (LCV-Liquid Crystal Light Valve) through the imaging lens (1), that is, on the optical addressable spatial light modulator . The semiconductor laser (6) emits a laser beam with a wavelength of 635 nanometers, which becomes parallel light through a beam expander lens (5) and a collimator lens (4) and shines on the polarization beam splitter prism (3). The polarization splitter prism (3) polarizes and refracts the parallel light onto the liquid crystal light valve (2). The readout light of the liquid crystal light valve (2) returns along the original path, and then enters the first Fourier lens (8) through the polarization beam splitter prism (3). Realize filtering according to the principle of the optical 4f system, that is, the electrical addressing spatial light modulator (9) is placed on the back focal plane of the Fourier lens (8), and the input filter function spectrum is controlled by the computer, and the image reading is completed here. The light spectrum is multiplied. Because the electrical addressing spatial light modulator (9) is on the front focal plane of the Fourier lens (10), the Fourier lens (10) converts the optical function from the frequency domain to the spatial domain, and finally the object image light through wavelet transform The function directly irradiates on the CCD photoelectric coupling device (11). The CCD optoelectronic coupling device (11) communicates with the computer (12), so that through the processing of converting incoherent light into coherent light, the electrical addressing spatial light modulator (9) controlled by the 4f system filtering principle and the computer (12) is used. , realize wavelet transform processing, and its signal is received by CCD photoelectric coupling device (11), and is read into computer (12).

本发明与现有技术相比有如下优点:Compared with the prior art, the present invention has the following advantages:

(1)基于小波变换光学实现机器人视觉传感器利用光学信息处理高速、并行和大容量的特征,提高信息处理速度。(1) Realize robot vision sensor based on wavelet transform optics Utilize the characteristics of high-speed, parallel and large-capacity optical information processing to improve information processing speed.

(2)基于小波变换光学实现机器人视觉传感器具有滤波性能好,消除多余噪声和干扰,提高信噪比、不存在截断误差,重复精度高及良好的数字数据序列重建特征等。(2) Based on wavelet transform optics, the robot vision sensor has good filtering performance, eliminates redundant noise and interference, improves signal-to-noise ratio, has no truncation error, high repeatability and good digital data sequence reconstruction characteristics, etc.

(3)基于小波变换光学实现机器人视觉传感器是光机电一体化的高技术产品,它也是光学与计算机结合的产物。计算机完成信号写入、计算、存贮、编程和控制等功能,直接控制机器人手臂运动。基于小波变换光学实现机器人视觉传感器安装到机器人上,可对目标进行识别,并实现自动跟踪。(3) Realization of robot vision based on wavelet transform optics The sensor is a high-tech product of optomechanical integration, and it is also the product of the combination of optics and computer. The computer completes functions such as signal writing, calculation, storage, programming and control, and directly controls the movement of the robot arm. Based on wavelet transform optics, the robot vision sensor is installed on the robot, which can identify the target and realize automatic tracking.

附图的图面说明如下:The descriptions of the attached drawings are as follows:

图1是本发明的结构示意图。Fig. 1 is a structural schematic diagram of the present invention.

下面结合附图对本发明实施例作进一步详述:Embodiments of the present invention are described in further detail below in conjunction with the accompanying drawings:

基于小波变换光学实现机器人视觉传感器的结构如图1所示:在“T”形壳体(7)的立筒内下端口处通过螺纹固装着成象物镜(1),成象物镜(1)的上方焦距处用紧定螺钉固装着液晶光阀(2)。液晶光阀(2)的上方、“T”形壳体立筒和斜筒轴线的交汇处安装着偏振分光棱镜(3),偏振分光棱镜(3)的上方通过螺纹固装着准直透镜(4),在壳体(7)内的上端口处卡接着半导体激光器(6),在半导体激光器(6)和准直透镜(5)之间通过螺纹固装着一个扩束透镜(5)。“T”形壳体(7)的斜筒内用紧定螺钉固装着傅里叶透镜(8)和傅里叶透镜(10),其位置要保证偏振分光棱镜(3)的读出光入射到傅里叶透镜(8)内,并使傅里叶透镜(8)的后焦平面与傅里叶透镜(10)前焦平面汇合在一处,且在焦平面汇合处安装着电寻址空间光调制器(9),在傅里叶透镜(10)的右方斜筒内的端口处通过螺纹固装着CCD光电耦合器件(11)。成象物镜(1)、液晶光阀(2)、偏振分光棱镜(3)、扩束透镜(4)、准直透镜(5)、半导体激光器(6)在同一轴线上。偏振分光棱镜(3)、傅里叶透镜(8)、电寻址空间光调制器(9)、傅里叶透镜(10)和CCD光电耦合器件(11)在同一轴线上。电寻址空间光调制器(9)和CCD光电耦合器件(11)分别用电缆与计算机(12)相连接。Realize the structure of the robot vision sensor based on wavelet transform optics as shown in Figure 1: the imaging objective lens (1) is fixedly installed by the screw thread at the lower port in the vertical tube of the "T" shaped housing (7), and the imaging objective lens (1) A liquid crystal light valve (2) is fixed with a set screw at the focal length above. A polarizing beamsplitter prism (3) is installed above the liquid crystal light valve (2) and at the intersection of the axis of the "T"-shaped housing vertical cylinder and the inclined cylinder, and the top of the polarizing beamsplitting prism (3) is fixed with a collimator lens (4 ), the semiconductor laser (6) is clamped at the upper port in the housing (7), and a beam expander lens (5) is fixedly installed by threads between the semiconductor laser (6) and the collimating lens (5). The Fourier lens (8) and the Fourier lens (10) are fixed with set screws in the oblique tube of the "T"-shaped housing (7), and its position should ensure that the readout light of the polarization beam splitter (3) is incident into the Fourier lens (8), and the rear focal plane of the Fourier lens (8) merges with the front focal plane of the Fourier lens (10), and an electric addressing device is installed at the intersection of the focal planes The spatial light modulator (9) is fixedly mounted with a CCD photoelectric coupling device (11) by threads at the port in the right oblique barrel of the Fourier lens (10). Imaging objective lens (1), liquid crystal light valve (2), polarization beam splitter prism (3), beam expander lens (4), collimator lens (5), semiconductor laser (6) are on the same axis. The polarization splitter prism (3), the Fourier lens (8), the electrical addressing spatial light modulator (9), the Fourier lens (10) and the CCD photoelectric coupling device (11) are on the same axis. The electrical addressing spatial light modulator (9) and the CCD photoelectric coupling device (11) are respectively connected with the computer (12) by cables.

液晶光阀(2)的分辨率为401p/mm,对比度为100∶1,写入时间为40ms。The resolution of the liquid crystal light valve (2) is 401p/mm, the contrast ratio is 100:1, and the writing time is 40ms.

偏振分光棱镜(3)分光角为78度。The beam splitting angle of the polarizing beam splitting prism (3) is 78 degrees.

半导体激光器(6)功率为10mW。The power of semiconductor laser (6) is 10mW.

电寻址空间光调制器(9)的象素数为800×600,画幅频率为200Hz,象元尺寸为33×33,填充因子为0.27,对比度为200∶1。The number of pixels of the electrical addressing spatial light modulator (9) is 800×600, the frame frequency is 200Hz, the pixel size is 33×33, the fill factor is 0.27, and the contrast ratio is 200:1.

CCD光电耦合器件(11)的型号为DH512-PRO。The model of CCD photocoupler (11) is DH512-PRO.

使用时,将基于光学小波变换机器人视觉传感器安装在机器人末端执行器的发兰上,并与计算机构成的系统和机器人控制器相连接,进行互相通讯,以控制机器人的手臂按着视觉传感器识别的路径作实时性跟踪运动,视觉传感器与被测物体间的距离为1米。When in use, the robot vision sensor based on optical wavelet transform is installed on the flange of the robot end effector, and is connected with the computer system and the robot controller to communicate with each other to control the robot's arm according to the position recognized by the vision sensor. The path is tracked in real time, and the distance between the visual sensor and the measured object is 1 meter.

在基于小波变换光学实现机器人视觉传感器的前端,预先制成安装变焦镜头的接口,接上变焦镜头后,本发明的基于小波变换光学实现视觉传感器可以获取远距离的物象,并对环境中的监测物进行监视。At the front end of the robot vision sensor based on wavelet transform optics, the interface for installing the zoom lens is made in advance, and after the zoom lens is connected, the vision sensor based on wavelet transform optics of the present invention can acquire long-distance objects and monitor the environment. things to monitor.

Claims (2)

1, a kind of based on wavelet transformation Optical Implementation vision sensor of robot, it is characterized in that: the lower port place is installing imaging object lens (1) in the upright tube of housing (7), the focal length place, top of imaging object lens (1) is installing liquid crystal light valve (2), the top of liquid crystal light valve (2), the intersection of upright tube of housing and oblique tube axis is installed with polarization splitting prism (3), the top of polarization splitting prism (3) is installing collimation lens (4), upper port place in housing (7) is installing semiconductor laser (6), between semiconductor laser (6) and collimation lens (5), installing an extender lens (5), installing fourier lense (8) and fourier lense (10) in the oblique tube of housing (7), its position will guarantee that the light of reading of polarization splitting prism (3) incides in the fourier lense (8), and make the back focal plane of fourier lense (8) and fourier lense (10) front focal plane merge in a place, and electrical addressing spatial light modulator (9) is installed herein, port in the right-hand oblique tube of fourier lense (10) is installing CCD photoelectric coupled device (11), imaging object lens (1), liquid crystal light valve (2), polarization splitting prism (3), extender lens (4), collimation lens (5), semiconductor laser (6) is on same axis, polarization splitting prism (3), fourier lense (8), electrical addressing spatial light modulator (9), fourier lense (10) and CCD photoelectric coupled device (11) are on same axis, and electrical addressing spatial light modulator (9) uses cable to be connected with computer (12) respectively with CCD photoelectric coupled device (11).
2, according to the said vision sensor of robot of claim 1, it is characterized in that: the resolution ratio of liquid crystal light valve (2) is 401p/mm, and contrast is 100: 1, and the write time is 40ms; The light spliting angle of polarization splitting prism (3) is the 45-90 degree; The power of semiconductor laser (6) is 5-15mW; The number of picture elements of electrical addressing spatial light modulator (9) is 800 * 600, and the picture frequency is 200Hz, and picture dot is of a size of 33 * 33, and fill factor, curve factor is 0.27, and contrast is 200: 1.
CN 01109002 2001-02-27 2001-02-27 Robot's visual sensor based on small-wave transform optics Expired - Fee Related CN1126649C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 01109002 CN1126649C (en) 2001-02-27 2001-02-27 Robot's visual sensor based on small-wave transform optics

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 01109002 CN1126649C (en) 2001-02-27 2001-02-27 Robot's visual sensor based on small-wave transform optics

Publications (2)

Publication Number Publication Date
CN1304822A CN1304822A (en) 2001-07-25
CN1126649C true CN1126649C (en) 2003-11-05

Family

ID=4657636

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 01109002 Expired - Fee Related CN1126649C (en) 2001-02-27 2001-02-27 Robot's visual sensor based on small-wave transform optics

Country Status (1)

Country Link
CN (1) CN1126649C (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5895305B2 (en) * 2011-12-06 2016-03-30 シーシーエス株式会社 Inspection illumination device and inspection illumination method
CN103019258A (en) * 2012-11-28 2013-04-03 中国人民解放军装甲兵工程学院 Multi-target tracking indicating technology based on optical phased array and reverse optics
CN104748721B (en) * 2015-03-22 2018-05-08 上海砺晟光电技术有限公司 A kind of monocular vision sensor with coaxial distance measurement function
CN106371272B (en) * 2015-07-20 2019-04-23 深圳光峰科技股份有限公司 The control system of light combination and projector
CN105044052A (en) * 2015-09-07 2015-11-11 中国科学院近代物理研究所 Laser spectrum analysis method and device for elements in liquid

Also Published As

Publication number Publication date
CN1304822A (en) 2001-07-25

Similar Documents

Publication Publication Date Title
CN104932092B (en) Auto-focusing microscope and its focusing method based on eccentric pencil method
US7446885B2 (en) Device for measuring in three dimensions a topographical shape of an object
CN101832760B (en) Remote three-dimensional micro-deformation visual on-line monitoring method and system
CN101303291B (en) Multi-channel multi-target hyperspectral imaging method and system based on digital micromirror device
Van der Jeught et al. Real-time microscopic phase-shifting profilometry
CN102095736B (en) Dual-optical-magnification image acquisition device and image acquisition control and process system
CN111965192A (en) A multi-faceted imaging visual inspection system and inspection method
US8169603B2 (en) Lens-testing apparatus and lens-testing method having a plurality of combinations of object distances
CN107621356A (en) A Microscope Focus Offset Measuring Equipment
JP2021530714A (en) Chromatic confocal area sensor
CN108152299A (en) The beauty defects detection device and detection method of high-precision optical element
CN1126649C (en) Robot's visual sensor based on small-wave transform optics
US6215549B1 (en) Apparatus for measuring optical characteristics
CN111638578A (en) Automatic light collimation coupling positioning device based on mirror image binocular vision
CN1209653C (en) Three-dimensional profile measuring method and equipment with optical fiber panel and confocal microscope
CN101033940A (en) Photo-electric autocollimation microscopic measuring instrument for three-dimensional detection and position of space object
CN108489830A (en) Crack propagation measuring system
CN209055782U (en) an autofocus system
CN208313565U (en) A kind of microscope focal shift measuring device
CN110187582A (en) A kind of imaging device of Displacement and its application
CN105372041B (en) A kind of coaxial focusing test device of double grating based on LabVIEW and focusing test method
CN2814330Y (en) Shear speckle interferometer
CN1888817A (en) Body surface three-dimensional topographic information measuring device
CN217930781U (en) An optical fiber end face detection device
CN208254426U (en) Portable two-dimensional dynamic photoelectric self-collimater device

Legal Events

Date Code Title Description
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C06 Publication
PB01 Publication
C14 Grant of patent or utility model
GR01 Patent grant
C19 Lapse of patent right due to non-payment of the annual fee
CF01 Termination of patent right due to non-payment of annual fee