[go: up one dir, main page]

CN1570707A - Projection system with image pickup device - Google Patents

Projection system with image pickup device Download PDF

Info

Publication number
CN1570707A
CN1570707A CNA031476384A CN03147638A CN1570707A CN 1570707 A CN1570707 A CN 1570707A CN A031476384 A CNA031476384 A CN A031476384A CN 03147638 A CN03147638 A CN 03147638A CN 1570707 A CN1570707 A CN 1570707A
Authority
CN
China
Prior art keywords
image
projection system
cursor
partial image
data processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA031476384A
Other languages
Chinese (zh)
Other versions
CN1292287C (en
Inventor
曾达琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BenQ Corp
Original Assignee
BenQ Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BenQ Corp filed Critical BenQ Corp
Priority to CNB031476384A priority Critical patent/CN1292287C/en
Publication of CN1570707A publication Critical patent/CN1570707A/en
Application granted granted Critical
Publication of CN1292287C publication Critical patent/CN1292287C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Position Input By Displaying (AREA)

Abstract

一种投影系统包括一投影机、一图像拾取器及一数据处理器。该投影机可分别将不可见光调变为一第一图像,及将可见光调变为一具有一光标的第二图像,并将该第一图像与该第二图像同时投影至一屏幕。图像拾取器包括一输出单元,该输出单元用来输出图像拾取器所得的第一图像。输出单元于一第一时间T1输出第一图像的一第一部分图像,于一第二时间T2输出第一图像的一第二部分图像。数据处理器用来接收输出单元传送的数据,以及根据第一部分图像与第二部分图像来改变光标的位置。

Figure 03147638

A projection system includes a projector, an image pickup device and a data processor. The projector can modulate invisible light into a first image and visible light into a second image with a cursor, and simultaneously project the first image and the second image onto a screen. The image pickup device includes an output unit, which is used to output the first image obtained by the image pickup device. The output unit outputs a first partial image of the first image at a first time T1, and outputs a second partial image of the first image at a second time T2. The data processor is used to receive data transmitted by the output unit, and change the position of the cursor according to the first partial image and the second partial image.

Figure 03147638

Description

Optical projection system with image pickup device
Technical field
The present invention relates to a kind of optical projection system, particularly relate to a kind of optical projection system that is used for controlling the image pickup device that cursor moves that has.
Background technology
General user when carrying out bulletin, can connect computing machine and projector with the image projection of computing machine to screen, and the user often needs to use some control device to come cursor on the operational computations machine.These devices comprise mouse, trace ball and rocking bar.Generally speaking, mouse inside has a spin, and when mouse-over one surface, the rolling amount of spin will be detected and with the amount of movement that decides cursor, makes cursor original position from the screen move to the position that the user wants.In order to make spin be applicable to different surfaces, reference position and any position on the screen that common spin moves all do not have fixing relation, and the user needs to be familiar with earlier such mode of operation.The principle and the mouse of trace ball are similar, but trace ball is that a spin is fixed on the point, and roll this spin of user produces rolling amount, with the amount of movement that decides cursor.Rocking bar is a kind of controller of column, can tilt to the direction of two coordinate axis, though the direction of the inclination of rocking bar directly corresponds to the direction of coordinate usually, operate but being not easy accurately.In addition, some rocking bar when different angles of inclination, the cursor on the screen has different translational speeds, so the user will have a twist of the wrist just can accurately control cursor.
Many remote control system for computer have developed the hobby that to meet the user and the control device of custom.Progress along with mechanics of communication, as wireless communication modes such as ultrasound wave, infrared ray and radio frequencies, can allow the user set up ditch messenger between controller and the computing machine, provide the user when making bulletin, have higher maneuverability to use cursor on control device operational computations machine and the screen.Tele-control system can be installed on inductor the relative position that detects user's moving cursor on controller, computing machine or the screen usually; yet in practical application; these technology tend to be subjected to the influence of length, width and the scope in space, for example need the system of complexity and expensive device just to be not suitable for the less occasion in application space.Except that computer screen, large-scale display device as projector, also often provides the instrument of vision interaction, still needs simple controllers to come the running of control computer in many bulletins.As when broadcasting lantern slide, next that will use that a controller controls lantern slide open, last one, first or last etc., and some relatively more professional bulletins, as the use of software or user's training, just wish that controller can allow user's cursor on operational computations machine screen or the large-scale display device intuitively.
Being equiped with the electric charge lotus root in certain projector attaches together to put and can be used to special ray on the sensing screen.For example, when the user pointed to certain position on the screen with the laser light pen, laser light was got back to projector via screen reflection, is attached together by the electric charge lotus root and puts sensing, and so, projector just can determine the direction that cursor moves.The benefit of using laser light pen maximum is exactly the cursor of user on very intuitively just can function screen.Yet when use has the electric charge lotus root when attaching together the projector of putting as photosensory assembly, the laser direction of light must extend to whole screen, so projector need handle more data.Laser light in addition, must be noted that safety when using laser light pen irradiation screen, because can produce very big injury when shining eyes.
From the above, user regular meeting when making bulletin connects projector with computing machine, and in order with the audience better interaction to be arranged, controller of user's needs comes the cursor on the control computer.Common controller, as mouse, trace ball, rocking bar and laser light pen etc., though the user does not need too many extra training, just can operate easily, but controllers such as mouse, trace ball and rocking bar need be operated on a fixing position, maneuverability is less, though and the laser light pen has higher maneuverability, laser light injures eyes easily, notes safety during use.
Summary of the invention
Therefore fundamental purpose of the present invention is to provide a kind of optical projection system, to address the above problem.
A kind of optical projection system is provided in the preferred embodiments of the present invention, can be with image projection to a screen, this optical projection system comprises a projector, an image pickup device and a data processor.Projector comprises a light source; One spectroscope; One first image-forming assembly; One second image-forming assembly and a prism.Spectroscope is installed on a side of light source, is used for the light beam that light source projects is come out is divided into a visible light beam and an invisible light beam.First image-forming assembly is used for the invisible light beam of modulation, to form one first image; Second image-forming assembly is used for the modulation visible light beam, and to form one second image, second image comprises a cursor at least.Prism is used on first and second image projection to one screen.In addition, image pickup device is used for picking up the part of first image on the screen.Image pickup device comprises an output unit, is used for first image of output image pick-up gained, and this output unit is exported first's image of first image in a very first time T1, in a second portion image of one second time T, 2 outputs, first image.Data processor is used for receiving the data that output unit transmits, and the position that changes cursor according to first's image and second portion image.
Description of drawings
Fig. 1 is the synoptic diagram of optical projection system of the present invention.
Fig. 2 and Fig. 3 are the synoptic diagram of Fig. 1 image pickup device inner structure.
Fig. 4 is the synoptic diagram of Fig. 1 projector inner structure.
Fig. 5 is the moving direction of cursor of the present invention and the synoptic diagram of amount of movement.
Accompanying drawing parts symbol description:
10 optical projection systems, 12 projectors
14 image pickup devices, 16 data processors
18 screens, 20,40 camera lenses
22 photosensory assemblies, 24 output units
26 processing units, 28 data transmission devices
30 light sources, 32 spectroscopes
34 first image-forming assemblies, 36 second image-forming assemblies
38 prisms
Embodiment
Referring to figs. 1 to Fig. 3, Fig. 1 is the synoptic diagram of optical projection system 10 of the present invention, and Fig. 2 and Fig. 3 are the synoptic diagram of Fig. 1 image pickup device 14 inner structures.As shown in Figure 1, optical projection system 10 comprises a projector 12, an image pickup device 14 and a data processor 16.Projector 12 is connected in data processor 16 with a transmission line or wireless telecommunications such as modes such as ultrasound wave, infrared ray and radio frequency.Data processor 16 can be desktop PC, mobile computer or PDA(Personal Digital Assistant) etc., and so the picture on the data processor 16 just can be projected on the screen 18 through projector 12.Image pickup device 14 also is connected with data processor 16 in the mode of transmission line or wireless telecommunications, is used for controlling the running of the mobile and data processor 16 of the cursor on the screen-picture.
Image pickup device 14 comprises two kinds of embodiments, in first embodiment, as shown in Figure 2, comprise a camera lens 20, a photosensory assembly 22 in the image pickup device 14, attach together as the electric charge lotus root and put (CCD) or a complementary metal oxide semiconductor (CMOS) and an output unit 24.Image pickup device 14 sees through camera lens 20 and picks up projector 12 continuously and be projected to a special graph (not shown) on the screen 18.The figure that photosensory assembly 22 picks up camera lens 20 divides other to be converted to graph data, by output unit 24 graph data is sent to data processor 16 again.In a second embodiment, as shown in Figure 3, comprise a processing unit 26 and a data transmission device 28 in the image pickup device 14 in addition.Processing unit 26 is connected in output unit 24, and data transmission device 28 is connected in processing unit 26.Output unit 24 can pick up camera lens 20 two continuous graph datas and was sent to earlier after processing unit 26 does to calculate this moment, exported data processor 16 to by data transmission device 28 again.In other words, camera lens 20 picks up first's image of the special graph on the screen 18 at a very first time T1, then pick up a second portion image of the special graph on the screen 18 in one second time T 2, output unit 24 exports first's image and second portion image to processing unit 26, the graph data that processing unit 26 is picked up according to the very first time T1 and second time T 2 calculates the moving direction and the amount of movement of cursor, by data transmission device 28 mobile data of cursor is sent to data processor 16 again.
With reference to figure 4, Fig. 4 is the synoptic diagram of projector's 12 inner structures.Projector 12 comprises a light source 30, a spectroscope 32, one first image-forming assembly 34, one second image-forming assembly 36, a prism 38 and a camera lens 40.The light that the light source 30 of projector 12 is sent comprises visible light and invisible light, and the picture that data processor 16 is exported only can be used the part of visible light, so in the present invention, utilizes the part of invisible light to form special graph.At first, the light beam that light source 30 is emitted is divided into visible light and invisible two parts with spectroscope 32.The part of visible light produces the picture image of data processor 16 after via second image-forming assembly, 36 modulations, and the part of invisible light produces special graph after via first image-forming assembly, 34 modulations.At last, accumulating a light beam through the visible light of modulation and invisible light by prism 38 sees through camera lens 40 and is projected on the screen 18.First image-forming assembly 34 and second image-forming assembly 36 are to be display panels (LCD) or digital micro-mirror device (DMD), and the photosensory assembly 22 of image pickup device 14 then is that invisible light is responded in special use.First image-forming assembly, 34 formed special graphs are in order to provide image pickup device 14 to pick up discrepant figure at different time points, as the moving direction that calculates cursor and the foundation of amount of movement, below be that example illustrates the figure that image pickup device 14 is picked up with the grid figure, and the account form of the moving direction of cursor and amount of movement.
With reference to figure 5, Fig. 5 is the moving direction of cursor and the synoptic diagram of amount of movement.The light source of projector 12 is divided into visible light and invisible light two parts via spectroscope 32, the part of visible light is tuned as the picture image of data processor 16 by second image-forming assembly 36, and the part of invisible light then is tuned as the rectangle grid by the first one-tenth pixel, 34 pictures and is covered with whole screen 18.The big I of rectangle grid cooperates the speed of image pickup device 14 captured images and decide, and the rectangle grid is littler, and then the precision that moves of cursor is higher, but the calculated amount of data processor 16 then more greatly.In the present embodiment, the mobile of control cursor is to adopt relative mode, and just the position coordinates of rectangle grid is irrelevant on the mobile and screen 18 of cursor.The starting point that cursor moves at every turn is exactly the position of cursor on screen 18, and direction that cursor moves and amount of movement then calculate according to image pickup device 14 continuous two graph data that picks up.For instance, the user directly moves facing to screen 18 with image pickup device 14 and controls moving of cursor, and image pickup device 14 is in that a very first time T1 and one second time T 2 are picked up different images respectively.As shown in Figure 4, the part of solid line is the first image of image pickup device 14 at very first time picture that T1 picks up, and the part of dotted line is the second portion image of image pickup device 14 at second time T 2 picture that picks up, with first's image and second portion image relay, can obtain grid at the side-play amount dx of vertical direction and the side-play amount dy of horizontal direction, suppose that dx is 8 pixels (pixel), dy is 2 pixels, then cursor can be moved to the left the distance of 8 pixels by the position that occurs, and moves down the distance of 2 pixels.
From the above, utilize spectroscope 32 that the visible light and the invisible light of light source 30 are separated in the projector 12, visible light is tuned as the picture of data processor by second image-forming assembly 36, the part of invisible light then is tuned as special graph by first image-forming assembly 34, with prism 38 this two bundles light is combined into a branch of light transmission camera lens 40 at last and is projected on the screen.The photosensory assembly 22 of image pickup device 14 is used for receiving invisible light, the figure that is induced to is sent to data processor 16 does computing, the user just can determine cursor moves on the screen 18 direction and amount of movement with the graphic change of any adjacent area on the image pickup device 14 scanning screens 18.In an embodiment of the present invention, easy two-dimensional rectangle grid figure is provided, direction and amount of movement that the variable quantity of utilization detection grid moves to obtain cursor, at first photosensory assembly 22 receives one first image in a very first time, when image pickup device 14 moves, photosensory assembly receives one second image in one second time, figure via first image and second image just can determine direction and the amount of movement that cursor moves, and at last by output unit 24 graph data is sent to data processor 16 in the mode of transmission line or wireless telecommunications.
Compare with known technology, optical projection system of the present invention provides a kind of operational light intuitively of user target mode, projector utilizes invisible light projection on screen to go out special graph, photosensory assembly in the image pickup device is used for detecting invisible light, the user is as long as directly move facing to screen with image pickup device, and data processor just can be controlled moving of cursor in the difference of figure that different time points is picked up according to image pickup device.Controller in the known optical projection system, as mouse, trace ball and rocking bar etc., though the controller that all is not to use the person to be familiar with, but all need on a fixing position, operate, maneuverability is less, though and the laser light pen has higher maneuverability, laser light but has the worry of injury eyes, so the invention provides the optical projection system of a kind of easy operation, mobility strong and safety.
The above only is the preferred embodiments of the present invention, and all equalizations of being done according to the present patent application claims scope change and modify, and all should belong to the covering scope of claims image pickup device of the present invention.

Claims (13)

1.一种投影系统,可将一图像投影至一屏幕,包括:1. A projection system capable of projecting an image onto a screen, comprising: 一投影机,该投影机包括:A projector, the projector includes: 一光源;a light source; 一分光镜,该分光镜安装于该光源的一侧,用来将该光源投射出来的光束分为一可见光束与一不可见光束;a beam splitter, the beam splitter is installed on one side of the light source, and is used to split the light beam projected by the light source into a visible light beam and an invisible light beam; 一第一成像组件,该第一成像组件用来调变该不可见光束,以形成一第一图像;a first imaging component, the first imaging component is used to modulate the invisible light beam to form a first image; 一第二成像组件,该第二成像组件用来调变该可见光束,以形成一第二图像,该第二图像至少包括一光标;以及a second imaging component, the second imaging component is used to modulate the visible light beam to form a second image, the second image includes at least a cursor; and 一棱镜,该棱镜用来将该第一与该第二图像投影至一屏幕上;a prism for projecting the first and the second images onto a screen; 一图像拾取器,该图像拾取器用来拾取该屏幕上该第一图像的一部分,该图像拾取器包括:An image pickup, the image pickup is used to pick up a part of the first image on the screen, the image pickup includes: 一输出单元,该输出单元用来输出该图像拾取器所得的该第一图像,该输出单元于一第一时间T1输出该第一图像的一第一部分图像,于一第二时间T2输出该第一图像的一第二部分图像;以及An output unit, the output unit is used to output the first image obtained by the image pickup device, the output unit outputs a first partial image of the first image at a first time T1, and outputs the first partial image at a second time T2 a second partial image of an image; and 一数据处理器,该数据处理器用来接收该输出单元传送的数据,以及根据该第一部分图像与该第二部分图像来改变该光标的位置。A data processor is used for receiving the data sent by the output unit, and changing the position of the cursor according to the first partial image and the second partial image. 2.如权利要求1所述的投影系统,其特征在于:该第一图像是为一方格矩阵。2. The projection system according to claim 1, wherein the first image is a grid matrix. 3.如权利要求1所述的投影系统,其特征在于:该数据处理器是藉由一传输线连接于该投影机。3. The projection system as claimed in claim 1, wherein the data processor is connected to the projector via a transmission line. 4.如权利要求1所述的投影系统,其特征在于:该数据处理器是通过一无线传输装置连接于该投影机。4. The projection system according to claim 1, wherein the data processor is connected to the projector through a wireless transmission device. 5.如权利要求1所述的投影系统,其特征在于:该数据处理器计算该第一部分图像与该第二部分图像的一差异,利用该差异计算出使用者欲移动该光标的一距离。5. The projection system as claimed in claim 1, wherein the data processor calculates a difference between the first partial image and the second partial image, and uses the difference to calculate a distance that the user wants to move the cursor. 6.如权利要求5所述的投影系统,其特征在于:该图像拾取器另包括一处理单元,用来计算该第一部分图像与该第二部分图像的一差异。6. The projection system as claimed in claim 5, wherein the image pickup further comprises a processing unit for calculating a difference between the first partial image and the second partial image. 7.如权利要求6所述的投影系统,其特征在于:该投影系统是配合一计算机主机使用,该图像拾取器还包括一数据传输装置,用以将该处理单元计算的该光标欲移动的距离,传送至该计算机主机,使该光标移动。7. The projection system according to claim 6, characterized in that: the projection system is used in conjunction with a computer host, and the image pickup device also includes a data transmission device for calculating the position of the cursor to be moved calculated by the processing unit The distance is sent to the host computer to move the cursor. 8.如权利要求5所述的投影系统,其特征在于:该投影系统另包括一计算机主机,该数据处理器是设置于该计算机主机内,用以计算该光标欲移动的距离,使该光标移动。8. The projection system as claimed in claim 5, characterized in that: the projection system further comprises a host computer, and the data processor is arranged in the host computer to calculate the distance that the cursor wants to move, so that the cursor move. 9.如权利要求1所述的投影系统,其特征在于:该输出单元是通过一电线将该第一部分图像与该第二部分图像传送至该数据处理器。9. The projection system as claimed in claim 1, wherein the output unit transmits the first partial image and the second partial image to the data processor through a wire. 10.如权利要求1所述的投影系统,其特征在于:该输出单元是通过一无线传输装置将该第一部分图像与该第二部分图像传送至该数据处理器。10. The projection system according to claim 1, wherein the output unit transmits the first partial image and the second partial image to the data processor through a wireless transmission device. 11.如权利要求1所述的投影系统,其特征在于:该第一成像组件及该第二成像组件是为液晶显示面板。11. The projection system as claimed in claim 1, wherein the first imaging component and the second imaging component are liquid crystal display panels. 12.如权利要求1所述的投影系统,其特征在于:该第一成像组件及该第二成像组件是为数字微镜装置。12. The projection system as claimed in claim 1, wherein the first imaging component and the second imaging component are digital micromirror devices. 13.如权利要求1所述的投影系统,其特征在于:该感光组件是为电荷耦合装置。13. The projection system as claimed in claim 1, wherein the photosensitive element is a charge-coupled device.
CNB031476384A 2003-07-15 2003-07-15 Projection system with image pickup device Expired - Fee Related CN1292287C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB031476384A CN1292287C (en) 2003-07-15 2003-07-15 Projection system with image pickup device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB031476384A CN1292287C (en) 2003-07-15 2003-07-15 Projection system with image pickup device

Publications (2)

Publication Number Publication Date
CN1570707A true CN1570707A (en) 2005-01-26
CN1292287C CN1292287C (en) 2006-12-27

Family

ID=34472002

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB031476384A Expired - Fee Related CN1292287C (en) 2003-07-15 2003-07-15 Projection system with image pickup device

Country Status (1)

Country Link
CN (1) CN1292287C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100504576C (en) * 2005-12-05 2009-06-24 财团法人资讯工业策进会 Device and method for synchronous operation of cursor and optical projection
CN101976154A (en) * 2010-07-27 2011-02-16 苏州瀚瑞微电子有限公司 Projection touch system
CN102243417A (en) * 2010-05-10 2011-11-16 中强光电股份有限公司 Optical device and projection system
CN102455779A (en) * 2010-10-15 2012-05-16 联想(北京)有限公司 Information processing device and method
CN104076914A (en) * 2013-03-28 2014-10-01 联想(北京)有限公司 Electronic equipment and projection display method
CN104951200A (en) * 2014-03-26 2015-09-30 联想(北京)有限公司 Method and device for executing interface operations
CN105824173A (en) * 2015-01-27 2016-08-03 财团法人工业技术研究院 Interactive projector and operating method thereof for determining depth information of an object

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100504576C (en) * 2005-12-05 2009-06-24 财团法人资讯工业策进会 Device and method for synchronous operation of cursor and optical projection
CN102243417A (en) * 2010-05-10 2011-11-16 中强光电股份有限公司 Optical device and projection system
US8567959B2 (en) 2010-05-10 2013-10-29 Coretronic Corporation Optical sensor and projection system thereof
CN101976154A (en) * 2010-07-27 2011-02-16 苏州瀚瑞微电子有限公司 Projection touch system
CN102455779A (en) * 2010-10-15 2012-05-16 联想(北京)有限公司 Information processing device and method
CN104076914A (en) * 2013-03-28 2014-10-01 联想(北京)有限公司 Electronic equipment and projection display method
CN104076914B (en) * 2013-03-28 2018-04-27 联想(北京)有限公司 A kind of electronic equipment and method for displaying projection
CN104951200A (en) * 2014-03-26 2015-09-30 联想(北京)有限公司 Method and device for executing interface operations
CN104951200B (en) * 2014-03-26 2018-02-27 联想(北京)有限公司 A kind of method and apparatus for performing interface operation
CN105824173A (en) * 2015-01-27 2016-08-03 财团法人工业技术研究院 Interactive projector and operating method thereof for determining depth information of an object

Also Published As

Publication number Publication date
CN1292287C (en) 2006-12-27

Similar Documents

Publication Publication Date Title
US7176881B2 (en) Presentation system, material presenting device, and photographing device for presentation
US6707444B1 (en) Projector and camera arrangement with shared optics and optical marker for use with whiteboard systems
RU2455676C2 (en) Method of controlling device using gestures and 3d sensor for realising said method
JP5822400B2 (en) Pointing device with camera and mark output
JP4822643B2 (en) Computer presentation system and method with optical tracking of a wireless pointer
US8723789B1 (en) Two-dimensional method and system enabling three-dimensional user interaction with a device
KR20050074802A (en) Interactive presentation system
JPH10333088A (en) Projection image display method and projection image display device
US7027041B2 (en) Presentation system
CN102096529A (en) Multipoint touch interactive system
US20120218225A1 (en) Optical scanning type touch apparatus and operation method thereof
CN1292287C (en) Projection system with image pickup device
US20200241721A1 (en) Interactive display apparatus and method
JP2018018308A (en) Information processing apparatus, control method therefor, and computer program
US6971753B2 (en) Projecting system with an image-capturing device
US9785253B2 (en) Pointing device using camera and outputting mark
US9329679B1 (en) Projection system with multi-surface projection screen
CN109816723A (en) Projection control method, device, projection interactive system and storage medium
US9489077B2 (en) Optical touch panel system, optical sensing module, and operation method thereof
US10403002B2 (en) Method and system for transforming between physical images and virtual images
CN209248473U (en) A kind of interactive display unit
KR20190085620A (en) Analysis apparatus of object motion in space and control method thereof
WO2001046941A1 (en) Method and apparatus for vision-based coupling between pointer actions and projected images
JP2003097914A (en) Position detecting device and position detecting program
JP7149915B2 (en) Projection device, projection method and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20061227