CN103300812A - Endoscope-based multispectral video navigation system and method - Google Patents

Abstract

The invention discloses an endoscope-based multi-spectral video navigation system and method. The system includes: an endoscope lens module for realizing endoscopy; a light source module for providing near-infrared and visible light sources; an optical signal acquisition module , used to collect near-infrared and visible light images; the multi-spectral conversion module, used to image different spectral bands; the control and processing module, used to control the camera and process the collected images to realize video navigation. The invention also discloses a method for multi-spectral video navigation by using the system. The present invention effectively solves the problem that most endoscopic fluorescent products can only see fluorescent images or visible light images, but cannot see multispectral images. The threshold of endoscopic imaging research has expanded the space for optical molecular imaging probes, and extended the scope of optical molecular imaging research and applications.

Description

Endoscope-based multispectral video navigation system and method

technical field

The invention relates to the technical field of optical imaging, in particular to an endoscope-based multispectral video navigation system and method.

Background technique

In recent years, due to the continuous development of molecular imaging technology, after radionuclide imaging, positron emission tomography, single photon emission computed tomography and magnetic resonance imaging, high-resolution optical imaging has appeared, among which near-infrared fluorescence imaging attention. However, even though optical molecular imaging has a wide range of applications, the tissue penetration depth is still a major obstacle to its wide application. How to achieve in-vivo depth detection is an urgent problem to be solved.

The endoscopic detection method has the advantages of controllable detection depth, which can effectively solve the problem of tissue penetration depth. Through the method of the invention, the fluorescent position can be observed and positioned in the body, and the endoscopic lens can enter into the tissue for depth detection.

At present, the single-spectral video imaging system is common on the market. This system has the disadvantages of single imaging spectrum and incomplete information. Multispectral imaging can effectively overcome the above shortcomings. However, most of the current multispectral imaging systems still use a single imaging device, using filter wheels for multispectral switching, and using the same imaging device time-sharing, which has great limitations in video imaging effects. The present invention adopts two imaging devices, and by sharing one optical path, different filter devices are added in front of the imaging devices to realize multispectral real-time imaging. On the imaging results, the information of different spectra is presented on the computer monitor, and the technicians realize the image navigation guidance operation.

Contents of the invention

The purpose of the present invention is to solve the above-mentioned defects in the prior art, and provide an endoscope-based multispectral video navigation system and method. According to the characteristics of optical molecular imaging and based on long-term research experience in the field of optical imaging, the present invention uses two cameras to realize functions such as acquisition of fluorescence, visible light and fusion images.

According to one aspect of the present invention, an endoscope-based multispectral imaging system is proposed, which includes: an endoscope lens module 110, a light source module 120, an optical signal acquisition module 130, a control and processing module 140, and a multispectral switching module 150, of which:

The endoscopic lens module 110 is used to endoscopically observe the detection area 100 of the tissue to be tested, and transmit the reflected light of the detection area 100 to the optical signal acquisition module 130;

The light source module 120 is connected to the endoscopic lens module 110 for providing excitation light and visible light to the endoscopic lens module 110;

The optical signal acquisition module 130 is connected to the endoscopic lens module 110, and is used to obtain fluorescence and visible light images according to the reflected light of the detection area 100 transmitted by the endoscopic lens module 110;

The control and processing module 140 is connected to the optical signal acquisition module 130, and is used to control the fluorescence camera 134 and the color camera 136 in the optical signal acquisition module 130, and collect the obtained optical signal by the optical signal acquisition module 130. The fluorescence and visible light images are processed and displayed, and the staff operates on the tissue to be tested according to the displayed fluorescence and visible light images;

The multi-spectrum switching module 150 is configured to provide filters of different spectra for the light source module 120 and the optical signal collection module 130 .

According to another aspect of the present invention, a method for performing multispectral imaging using the endoscope-based multispectral imaging system is proposed, the method comprising the following steps:

Step S1, making the excitation light source 121 and the visible light source 123 respectively illuminate the detection area 100;

Step S2, according to the detection characteristics, the spectrum switching module 150 sets the parameters of the optical filters in the light source module 120 and the optical signal acquisition module 130;

Step S3, the control module 141 adjusts the imaging parameters of the fluorescence camera 134 and the color camera 136, and the fluorescence camera 134 and the color camera 136 acquire images according to the reflected light with different spectra or energies in the detection area 100 respectively;

Step S4, the image processing module 142 processes the images collected by the fluorescence camera 134 and the color camera 136;

Step S5, the display module 143 displays the processed image obtained in the step S4 in real time, if the displayed image does not meet the definition requirement, the parameters of the lens 131 are adjusted through the optical signal acquisition module 130 until the displayed image The image displayed by module 143 meets the definition requirement;

In step S6, the endoscopic lens module 110 is moved to search for a fluorescent object in the detection area 100 of the tissue to be measured, and finally a clear image of the fluorescent object is obtained.

The invention realizes the excitation of the light source and the collection of light through the endoscopic lens module, the optical signal acquisition module collects the light in real time, the multi-spectral conversion module filters the light of different spectral bands, and the control and processing module performs real-time collection of the collected image information The processing of images of different spectral bands is stitched together to achieve spectral image fusion and display, so that the staff can perform targeted operations on the tissue to be tested according to the displayed fluorescence and visible light images. At present, most endoscopic fluorescence products on the market use a single CCD camera for imaging. The disadvantage is that only fluorescence images or visible light images can be seen during imaging, and multi-spectral images cannot be seen. However, the present invention effectively solves this problem, breaks the technological monopoly of foreign companies in China, lowers the threshold for multispectral endoscopic imaging research, expands the space for optical molecular imaging probes, and extends the The scope of research and application of optical molecular imaging.

Description of drawings

Fig. 1 is the structural block diagram of the multispectral video navigation system based on endoscope of the present invention;

Fig. 2 is the system schematic diagram of the multispectral video navigation system based on endoscope in the present invention;

Fig. 3 is a flow chart of the multispectral video navigation method based on endoscope in the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

According to one aspect of the present invention, a kind of multi-spectral video navigation system based on endoscope is proposed, Fig. 1 is the structural block diagram of the multi-spectral video navigation system based on endoscope of the present invention, Fig. 2 is the multi-spectral video navigation system based on endoscope of the present invention The system schematic diagram of the multi-spectral video navigation system, as shown in Figure 1 and Figure 2, the multi-spectral video navigation system includes: endoscopic lens module 110, light source module 120, optical signal acquisition module 130, control and processing module 140 and Multispectral switching module 150, wherein:

The endoscopic lens module 110 is used to endoscopically observe the detection area 100 of the tissue to be tested, and transmit the reflected light of the detection area 100 to the optical signal acquisition module 130;

The light source module 120 is connected to the endoscopic lens module 110, and is used to provide excitation light and visible light for the endoscopic lens module 110, and the visible light is used as background illumination light;

The optical signal acquisition module 130 is connected to the endoscopic lens module 110, and is used to obtain fluorescence and visible light images according to the reflected light of the detection area 100 transmitted by the endoscopic lens module 110;

The control and processing module 140 is connected to the optical signal acquisition module 130, and is used to control the fluorescence camera 134 and the color camera 136 in the optical signal acquisition module 130, and collect the obtained optical signal by the optical signal acquisition module 130. The fluorescence and visible light images are processed and displayed, and the staff operates on the tissue to be tested according to the displayed fluorescence and visible light images;

The multi-spectrum switching module 150 is configured to provide filters of different spectra for the light source module 120 and the optical signal collection module 130 .

The endoscope lens module 110 further includes an excitation light fiber 111, a visible light fiber 112 and a signal collection fiber 113, and the excitation light fiber 111 and the visible light fiber 112 are distributed around the signal collection fiber 113, wherein the excitation light The optical fiber 111 is connected to the filter one 122 in the light source module 120, and is used to guide the excitation light emitted by the excitation light source 121 in the light source module 120, so as to irradiate the detection region 100 with excitation light; The visible light fiber 112 is connected to the filter 2 124 in the light source module 120, and is used to guide the visible light emitted by the visible light source 123 in the light source module 120 to provide an illumination source for the detection area 100; the signal The collection optical fiber 113 is connected to the front end of the lens 131 in the optical signal collection module 130, and is used to collect the reflected light of the excitation light and visible light in the detection area 100, and guide the reflected light to the lens 131 place.

The light source module 120 further includes an excitation light source 121, a filter one 122, a visible light source 123 and a second filter 124, wherein the excitation light source 121 communicates with the endoscope lens module through the filter one 122 The excitation light fiber 111 in 110 is connected to provide excitation light for the excitation light fiber 111. The excitation light source 121 can be a wide-spectrum light source such as a wavelength-tunable laser or a tungsten halogen lamp; the visible light source 123 passes through the The second optical filter 124 is connected to the visible light fiber 112 in the endoscope lens module 110, and is used to provide visible light for the visible light fiber 112. The visible light source 123 can use a narrow spectrum band such as a tungsten halogen lamp or an LED lamp. Specific wavelength or band light source.

The optical signal acquisition module 130 further includes a lens 131, a dichroic prism 132, an optical filter three 133, a fluorescence camera 134, an optical filter four 135 and a color camera 136, wherein the lens 131 and the endoscope lens module The signal collecting optical fiber 113 in 110 is connected, and is used for guiding described emitting light to described dichroic prism 132 place, and adjusts imaging definition by adjusting parameters such as focal length, focus ring; Described dichroic prism 132 is composed of The beam-splitting prism or 55 beam-splitting prisms and other beam-splitting elements, the incident light end of the beam-splitting prism 132 is connected to the end of the lens 131, and the two outgoing ends of the beam-splitting prism 132 respectively pass through the filter 3 133 and the filter 135 is connected with the fluorescent camera 134 and the color camera 136, and is used to divide a beam of light transmitted by the lens 131 into two beams according to the spectrum or energy of the light; the fluorescent camera 134 and the color camera 136 pass through the data line 101 is connected to the control and processing module 140 , and is used to perform imaging according to the outgoing light of the dichroic prism 132 , and transmit the obtained images with different spectra or different energies to the control and processing module 140 .

The control and processing module 140 further includes a control module 141, an image processing module 142 and a display module 143, wherein the control module 141 is used for imaging parameters (such as exposure time, etc.) of the fluorescence camera 134 and the color camera 136 Controlling; the image processing module 142 is used to process the image data captured by the fluorescent camera 134 and the color camera 136, the processing includes at least image fusion, and may also include processing operations such as image denoising; the The display module 143 is used to display the images processed by the image processing module 142 in real time for the staff to observe and perform treatment operations on the tissue to be measured, so that the system realizes the function of multi-spectral video navigation.

The multi-spectral switching module 150 is a filter wheel device, which is used to adjust the spectral bands of each filter according to the excitation characteristics of different fluorescent lights, so as to ensure the excitation and collection of multi-spectral light and avoid mutual interference of different spectral light. Once the spectral band of the filter is adjusted, it will not be switched during the whole real-time navigation. The number of the optical filters can be installed according to the needs. In one embodiment of the present invention, the number of the optical filters is 4: optical filter one 122, optical filter two 124, optical filter three 133 and Optical filter four 135, the spectral band of described optical filter is near-infrared range, specifically:

The spectral band of filter one 122 is 710nm-770nm, and the diameter is 25mm;

The spectral band of filter 2 124 is 400nm-650nm, and the diameter is 25mm;

The spectral band of the third filter 133 is 810nm-870nm, and the diameter is 50mm;

The spectral band of filter four 135 is 400nm-650nm, and the diameter is 50mm.

During the actual use of the operator, the filter with a suitable spectrum can be switched according to the specific needs.

According to another aspect of the present invention, also propose a kind of method utilizing described multi-spectral video navigation based on endoscope, described method comprises the following steps:

Step S1, making the excitation light source 121 and the visible light source 123 respectively illuminate the detection area 100;

Step S2, according to the detection characteristics, the spectrum switching module 150 sets the parameters of the optical filters in the light source module 120 and the optical signal acquisition module 130;

Step S3, the control module 141 adjusts the imaging parameters of the fluorescence camera 134 and the color camera 136, and the fluorescence camera 134 and the color camera 136 acquire images according to the reflected light with different spectra or energies in the detection area 100 respectively;

Step S4, the image processing module 142 processes the images collected by the fluorescence camera 134 and the color camera 136, the processing includes at least image fusion, and may also include processing operations such as image denoising;

Step S5, the display module 143 performs real-time video display on the processed image obtained in the step S4, if the displayed image does not meet the definition requirement, then adjust the parameters of the lens 131 through the optical signal acquisition module 130 until the The image displayed by the display module 143 meets the definition requirement;

Step S6, moving the endoscopic lens module 110, looking for fluorescent objects in the detection area 100 of the tissue to be tested, and finally obtaining and displaying a clear image of the fluorescent objects;

In step S7, the staff operates on the tissue to be tested according to the clear image of the fluorescent object.

The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. multi-optical spectrum imaging system based on endoscope, it is characterized in that, this system comprises: endoscope head module (110), light source module (120), optical signalling acquisition module (130), control and processing module (140) and multispectral handover module (150), wherein:

Described endoscope head module (110), in the search coverage (100) of tissue to be measured is carried out, peep, and the reflected light of described search coverage (100) is transferred to described optical signalling acquisition module (130):

Described light source module (120) is connected with described endoscope head module (110), is used to described endoscope head module (110) that exciting light and visible light are provided;

Described optical signalling acquisition module (130) is connected with described endoscope head module (110), is used for obtaining fluorescence and visible images according to the reflected light of the described search coverage (100) of described endoscope head module (110) transmission;

Described control is connected with described optical signalling acquisition module (130) with processing module (140), be used for fluorescence camera (134) and the color camera (136) of described optical signalling acquisition module (130) are controlled, the fluorescence that described optical signalling acquisition module (130) is collected and visible images are processed and are shown, the staff operates for described tissue to be measured according to the fluorescence that demonstrates and visible images;

Described multispectral handover module (150) is used to described light source module (120) and described optical signalling acquisition module (130) that the optical filter of different spectrum is provided.

2. system according to claim 1 is characterized in that, described endoscope head module (110) further comprises exciting light optical fiber (111), visible light optical fiber (112) and signals collecting optical fiber (113), wherein:

Described exciting light optical fiber (111) is connected with optical filter one (122) in the described light source module (120), be used for being guided out the exciting light that the excitation source (121) of described light source module (120) sends, so that described search coverage (100) is carried out excitation light irradiation;

Described visible light optical fiber (112) is connected with optical filter two (124) in the described light source module (120), for the visible light that the visible light source (123) that is guided out described light source module (120) sends, think that described search coverage (100) provides lighting source;

The front end of the camera lens (131) in described signals collecting optical fiber (113) and the described optical signalling acquisition module (130) is connected, be used for gathering described exciting light and visible light at the reflected light of described search coverage (100), and described reflected light is guided to described camera lens (131) locate.

3. system according to claim 2 is characterized in that, described exciting light optical fiber (111), visible light optical fiber (112) be distributed in described signals collecting optical fiber (113) around.

4. system according to claim 1 is characterized in that, described light source module (120) further comprises excitation source (121), optical filter one (122), visible light source (123) and optical filter two (124), wherein:

Described excitation source (121) is connected with exciting light optical fiber (111) in the described endoscope head module (110) by described optical filter one (122), is used to described exciting light optical fiber (111) that exciting light is provided;

Described visible light source (123) is connected with visible light optical fiber (112) in the described endoscope head module (110) by described optical filter two (124), is used to described visible light optical fiber (112) that visible light is provided.

5. system according to claim 4 is characterized in that, described excitation source (121) adopts the wide spectrum light source, and described visible light source (123) adopts narrow spectral coverage specific wavelength or wave band light source.

6. system according to claim 1, it is characterized in that, described optical signalling acquisition module (130) further comprises camera lens (131), Amici prism (132), optical filter three (133), fluorescence camera (134), optical filter four (135) and color camera (136), wherein:

Described camera lens (131) is connected with signals collecting optical fiber (113) in the described endoscope head module (110), is used for that described utilizing emitted light is guided to described Amici prism (132) and locates and be adjusted to image sharpness;

The incident light end of described Amici prism (132) links to each other with the end of described camera lens (131), two exit ends link to each other with color camera (136) with described fluorescence camera (134) with optical filter four (135) by optical filter three (133) respectively, are used for the Ray Of Light of described camera lens (131) transmission is divided into two bundles according to the spectrum of light or the difference of energy;

Described fluorescence camera (134) is connected 136 with color camera) be connected with processing module (140) with described control by data wire (101), be used for carrying out imaging according to the emergent ray of described Amici prism (132), and with the image transmitting with different spectrum or different-energy that obtains respectively to described control and processing module (140).

7. system according to claim 6 is characterized in that, described Amici prism (132) forms to Amici prism or 55 Amici prisms by two.

8. system according to claim 1 is characterized in that, described control and processing module (140) further comprise control module (141), image processing module (142) and display module (143), wherein:

Described control module (141) is used for the imaging parameters of described fluorescence camera (134) and color camera (136) is controlled;

Described image processing module (142) is used for the view data that described fluorescence camera (134) and color camera (136) shooting obtain is processed;

Described display module (143) is used for showing in real time for the image that obtains after described image processing module (142) processing.

9. system according to claim 1, it is characterized in that, described multispectral handover module (150) is the filter wheel device, be used for the exciting characteristic according to different fluorescence, adjust the spectral coverage of each optical filter, to guarantee exciting and gathering of multispectral light, avoid the phase mutual interference of different spectrum light.

10. one kind is utilized method of carrying out multispectral imaging based on the multi-optical spectrum imaging system of endoscope claimed in claim 1, it is characterized in that, the method may further comprise the steps:

Step S1 makes excitation source (121) and visible light source (123) shine respectively search coverage (100);

Step S2, according to detection feature, spectrum handover module (150) arranges for the parameter of optical filter in light source module (120), the optical signalling acquisition module (130);

Step S3, control module (141) is adjusted the imaging parameters of fluorescence camera (134) and color camera (136), and described fluorescence camera (134) and color camera (136) collect image according to the reflected light that described search coverage (100) has different spectrum or an energy respectively;

Step S4, image processing module (142) is processed the image that described fluorescence camera (134) and color camera (136) collect;

Step S5, image after the processing that display module (143) obtains for described step S4 shows in real time, if the image that shows does not reach the definition requirement, then come the parameter of adjustable lens (131) by optical signalling acquisition module (130), until the image that described display module (143) shows reaches the definition requirement;

Step S6, mobile endoscope head module (110) is sought fluorescent object in the search coverage (100) of tissue to be measured, finally obtain the picture rich in detail of described fluorescent object;

Step S7, the staff operates for described tissue to be measured according to the picture rich in detail of described fluorescent object.

Images