WO2015072432A1 - Capsule endoscope and capsule endoscope system - Google Patents
Capsule endoscope and capsule endoscope system Download PDFInfo
- Publication number
- WO2015072432A1 WO2015072432A1 PCT/JP2014/079757 JP2014079757W WO2015072432A1 WO 2015072432 A1 WO2015072432 A1 WO 2015072432A1 JP 2014079757 W JP2014079757 W JP 2014079757W WO 2015072432 A1 WO2015072432 A1 WO 2015072432A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- capsule endoscope
- imaging
- wavelength component
- light
- illumination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
- A61B1/0684—Endoscope light sources using light emitting diodes [LED]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/041—Capsule endoscopes for imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0653—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with wavelength conversion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0655—Control therefor
Definitions
- the present invention relates to a capsule endoscope that is introduced into a subject and acquires image information by imaging the inside of the subject, and an image in the subject using image information acquired by the capsule endoscope.
- the present invention relates to a capsule endoscope system that creates
- a spectral image of each color component is acquired by irradiating the subject with light of a plurality of types of wavelength components (that is, color lights of a plurality of colors).
- a narrow band filter built-in electronic endoscope system hereinafter referred to as NBI
- NBI narrow band filter built-in electronic endoscope system
- each color component is separated by a surface-sequential method in which red (R), green (G), and blue (B) light beams narrowed by a narrow-band bandpass filter are sequentially irradiated to an organ or the like in a subject. Take an image.
- a wavelength component of 415 nm which is an absorption band of hemoglobin, and a color component in the vicinity thereof (that is, a blue component) are easily absorbed.
- a white LED is conventionally used as a light source.
- the level of the blue component data is very low and dark compared to the red component data that has relatively little absorption in the subject. Only spectral images could be obtained.
- the blue component data well reflects the fine structure of the surface tissue in the subject, it is desired to obtain an image with a high level of blue component data.
- the present invention has been made in view of the above, and an object of the present invention is to provide a capsule endoscope and a capsule endoscope system that can acquire an image with a high data level of a desired color component. To do.
- a capsule endoscope includes a light-emitting element that generates light including a first wavelength component when a current flows, and the first wavelength.
- a phosphor that generates light including a second wavelength component different from the first wavelength component by absorbing light including the component, and includes illumination light including the first and second wavelength components.
- Illuminating means capable of emitting light, imaging means for capturing an image of a subject illuminated by illumination light generated by the illuminating means, and acquiring image data; and the illuminating means in synchronization with an imaging operation of the imaging means
- Control means for controlling the switching of the spectral characteristics of the illumination light generated by the illumination means by changing the magnitude of the current passed through the illumination means.
- control unit switches a spectral characteristic of illumination light generated by the illumination unit during a single exposure period of still image capturing.
- the control unit is different from the first spectral characteristic after emitting light having the first spectral characteristic for a predetermined period when the imaging operation by the imaging unit is started.
- the light having the second spectral characteristic is emitted for a predetermined period.
- the first spectral characteristic and the second spectral characteristic are the first wavelength component and the second wavelength component included in the illumination light generated by the illumination unit. It is characterized by different intensity ratios.
- a center wavelength of the first wavelength component is shorter than a center wavelength of the second wavelength component, and the first spectral characteristic has a first wavelength with respect to the second wavelength component.
- the intensity ratio of the first wavelength component to the second wavelength component is smaller than the intensity ratio in the first spectral characteristic. It is characterized by.
- a light emission period of the light having the first spectral characteristic is longer than a light emission period of the light having the second spectral characteristic.
- the first wavelength component is any of 400 nm to 470 nm.
- a capsule endoscope system includes the capsule endoscope and an image processing apparatus that processes image data acquired by the capsule endoscope.
- the imaging unit acquires image data of each color component of red, green, and blue, and the image processing device creates a spectral image of each color component based on the image data. It is characterized by that.
- the capsule endoscope according to the present invention has a light emitting element that generates light including a first wavelength component when current flows, and the first endoscope that absorbs light including the first wavelength component.
- the plurality of types of illumination light are illumination light having different intensity ratios between the first wavelength component and the second wavelength component included in the illumination light generated by the illumination unit. It is characterized by being.
- a center wavelength of the first wavelength component is shorter than a center wavelength of the second wavelength component
- the control unit is configured to control the imaging unit with respect to the second wavelength component.
- the intensity ratio of the first wavelength component to the second wavelength component is
- a second imaging under illumination light having a second spectral characteristic smaller than the intensity ratio in the first spectral characteristic is performed at the imaging interval.
- an exposure time in the first imaging is longer than an exposure time in the second imaging.
- the first wavelength component is any of 400 nm to 470 nm.
- a capsule endoscope system includes the capsule endoscope and an image processing apparatus that processes image data acquired by the capsule endoscope.
- the image processing device creates a plurality of images based on the image data respectively acquired by the plurality of times of imaging, and corresponding pixels of the plurality of images A composite image is created by adding values.
- the image processing device creates a plurality of images based on the image data respectively acquired by the plurality of times of imaging, and includes any one of the plurality of images.
- a composite image is created by replacing the pixel value of the pixel saturated in step 1 with the pixel value of the corresponding pixel in another image of the plurality of images.
- the imaging unit acquires image data of each color component of red, green, and blue, and the image processing device is based on the image data acquired by the plurality of imaging operations, A spectral image of each of the color components is created.
- the present invention since the spectral characteristics of the light illuminating the inside of the subject are switched in synchronization with the imaging operation, it is possible to acquire an image having a high data level of a desired color component.
- FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system according to Embodiment 1 of the present invention.
- FIG. 2 is a block diagram corresponding to the capsule endoscope system shown in FIG.
- FIG. 3 is a schematic diagram showing an example of the structure of a pseudo white type white LED.
- FIG. 4A is a graph schematically showing spectral characteristics of the blue LED shown in FIG.
- FIG. 4B is a graph schematically showing spectral characteristics of fluorescence generated by the phosphor shown in FIG.
- FIG. 5 is a chromaticity diagram.
- FIG. 6 is a graph schematically showing the spectral characteristics of white light emitted from the white LED (when the drive current is increased).
- FIG. 7 is a graph schematically showing the spectral characteristics of white light emitted from the white LED (when the drive current is weakened).
- FIG. 8 is a diagram for explaining a control operation by the control unit of the capsule endoscope shown in FIG.
- FIG. 9A is a schematic diagram illustrating a data level (when spectral characteristics are changed) of image data output by the imaging unit for each imaging period.
- FIG. 9B is a schematic diagram illustrating the data level (when the spectral characteristics are constant) of the image data output by the imaging unit for each imaging period.
- FIG. 10 is a diagram for explaining the control operation of the control unit in the second embodiment.
- FIG. 11A is a schematic diagram illustrating a data level (when the drive current is increased) of image data output each time the imaging unit performs imaging once.
- FIG. 11B is a schematic diagram illustrating a data level (when the drive current is weakened) of image data output each time the imaging unit performs imaging once.
- FIG. 12 is a diagram for
- FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system according to Embodiment 1 of the present invention.
- the capsule endoscope system 1 acquires image data by being introduced into a subject 2 and imaging the subject 2, and is superimposed on a radio signal.
- the capsule endoscope 10 to be transmitted, the reception device 20 for receiving the radio signal transmitted from the capsule endoscope 10 via the reception antenna unit 3 attached to the subject 2, and the capsule endoscope
- the image processing apparatus 30 includes image processing apparatus 30 that captures image data acquired by the endoscope 10 via the receiving apparatus 20 and creates an image in the subject 2 using the image data.
- FIG. 2 is a block diagram showing the capsule endoscope system 1.
- the capsule endoscope 10 is a device in which various components such as an image sensor are incorporated in a capsule-shaped housing that is sized to allow the subject 2 to swallow.
- the capsule endoscope 10 includes an imaging unit 11 that images the inside of the subject 2,
- An illumination unit 12 that illuminates the inside of the sample 2,
- a control unit 13, a memory 14, a transmission unit 15, an antenna 16, and a power supply unit 17 are provided.
- the imaging unit 11 generates an imaging signal representing the inside of the subject 2 from an optical image formed on the light receiving surface and outputs it, such as a CCD or CMOS, and is disposed on the light receiving surface side of the imaging device. And an optical system such as an objective lens.
- the imaging device is a color sensor that outputs image data (R data, G data, B data) corresponding to each color component (wavelength component) of red (R), green (G), and blue (B).
- the illumination unit 12 includes a white LED (Light Emitting Diode) that emits white light.
- the light emitting method of the white LED is a method using a blue LED and a complementary yellow fluorescent material (hereinafter referred to as a pseudo white method), a purple (or near-ultraviolet) LED, and three types of red, green, and blue.
- a pseudo white white LED is used among these methods.
- FIG. 3 is a schematic diagram for explaining a mechanism of light emission of the pseudo white type white LED.
- the white LED includes a substrate 121, a cavity 122 disposed on the substrate 121, a blue LED 123 mounted on the substrate 121, and a fluorescent light disposed within the cavity 122 and covering the blue LED 123.
- a body 124 and a transparent resin 125 that seals these parts are provided.
- the blue LED 123 includes, for example, a gallium nitride crystal, and generates blue light having a center wavelength ⁇ 1 ( ⁇ 1 is, for example, about 400 nm to 470 nm) when a current flows (see FIG. 4A).
- the phosphor 124 is obtained by mixing, for example, a YAG (yttrium, aluminum, garnet) yellow fluorescent agent with a transparent resin material such as epoxy or silicon resin, and is excited by blue light emitted from the blue LED 123. Then, yellow light (fluorescence) having a center wavelength ⁇ 2 ( ⁇ 2 > ⁇ 1 , ⁇ 2 is about 520 nm to 640 nm, for example) is generated (see FIG. 4B).
- a YAG yttrium, aluminum, garnet
- a transparent resin material such as epoxy or silicon resin
- FIG. 5 is a chromaticity diagram for explaining the principle of color mixing.
- Each coordinate on the boundary line (edge) of the chromaticity diagram indicates a pure color component, and a numerical value written on the boundary line indicates a wavelength of each color component.
- Each coordinate inside the boundary line indicates a color mixture.
- white light is mixed by mixing color components (for example, wavelengths ⁇ 1 and ⁇ 2 ) shown at both ends of a straight line (for example, a straight line L) passing through a white region W near the center at a ratio in a predetermined range. Can be generated.
- FIG. 6 and 7 are graphs schematically showing the spectral characteristics of white light emitted by the white LED, and FIG. 6 shows a case where the drive current of the white LED is increased compared to FIG. .
- the blue light emitted from the blue LED 123 there is an upper limit to the amount of light that can be absorbed by the phosphor 124. For this reason, even if the intensity of the current is changed, the intensity of the yellow light generated by the phosphor 124 does not change much.
- the driving current is increased, the intensity of blue light generated from the blue LED 123 and transmitted without being absorbed by the phosphor 124 is increased.
- the spectral characteristics of the white light emitted by the white LED can be changed. Specifically, by increasing the drive current, as shown in FIG. 6, white light having a spectral characteristic C1 in which the emission intensity of the blue component at the center wavelength ⁇ 1 is stronger than that of the yellow component at the center wavelength ⁇ 2 is emitted. The That is, the intensity ratio of the blue component to the yellow component is greater than 1. On the other hand, by reducing the drive current, as shown in FIG. 7, the intensity ratio of the blue component to the yellow component becomes smaller than that of the spectral characteristic C1, and the emission intensity of the blue component and the yellow component is approximately the same (intensity). White light having a spectral characteristic C2 having a ratio of about 1 is emitted.
- the control of the spectral characteristics by adjusting the driving current as described above conceptually corresponds to changing the chromaticity of the light emitted by the white LED on the straight line L in the chromaticity diagram shown in FIG. Therefore, by appropriately setting a range (range corresponding to the spectral characteristics C1 and C2) in which the drive current passed through the white LED is changed, it is possible to emit white light having different color mixture ratios (intensity ratios) of the respective color components. Note that when the drive current is changed, the chromaticity of the white light emitted by the white LED does not always change linearly on the chromaticity diagram, and is slightly curved according to the characteristics of the white LED. There are things to do.
- emission wavelength lambda 1 of the blue LED 123 in the case of imaging the in vivo, it is preferable to use an LED that emits blue light absorption wavelength 415nm or near the hemoglobin .
- the capsule endoscope 10 incorporates a circuit board (not shown) on which an imaging drive circuit for driving the imaging unit 11 and an illumination drive circuit for driving the illumination unit 12 are formed. Yes.
- the imaging unit 11 and the illumination unit 12 are fixed to the circuit board in a state where the visual field is directed outward from one end of the capsule endoscope 10.
- the control unit 13 controls each unit in the capsule endoscope 10 to cause the imaging unit 11 to perform an imaging operation, and performs A / D conversion and a predetermined signal on the imaging signal output from the imaging unit 11. Processing is performed to obtain digital image data. More specifically, the control unit 13 performs control to switch the light emission state of the illumination unit 12 by changing the magnitude of the drive current of the illumination unit 12 within one drive period (imaging period) of the imaging unit 11. I do. Note that the light emission state switching control is executed, for example, by switching a resistance included in the illumination driving circuit with a switch circuit and changing the magnitude of the driving current.
- the memory 14 stores an execution program and a control program for the control unit 13 to execute various operations. Further, the memory 14 may temporarily store image data or the like that has been subjected to signal processing in the control unit 13.
- the transmission unit 15 and the antenna 16 superimpose the image data stored in the memory 14 together with related information on a radio signal and transmit the image data to the outside.
- the related information includes identification information (for example, a serial number) assigned to identify the individual capsule endoscope 10.
- the power supply unit 17 includes a battery made of a button battery or the like, a power supply circuit that boosts power from the battery, and a power switch that switches an on / off state of the power supply unit 17. Electric power is supplied to each part in the mold endoscope 10.
- the power switch is, for example, a reed switch that can be turned on and off by an external magnetic force. Before the capsule endoscope 10 is used (before the subject 2 swallows), the capsule endoscope 10 is externally connected. It can be switched on by applying a magnetic force.
- Such a capsule endoscope 10 is swallowed by the subject 2 and then moves in the digestive tract of the subject 2 by a peristaltic movement of an organ or the like, while a living body part (esophagus, stomach, small intestine, large intestine, etc.) Are sequentially imaged at a predetermined cycle (for example, a cycle of 0.5 seconds). Then, the image data and related information acquired by the imaging operation are sequentially wirelessly transmitted to the receiving device 20.
- a predetermined cycle for example, a cycle of 0.5 seconds
- the receiving device 20 includes a receiving unit 21, a signal processing unit 22, a memory 23, a data transmission / reception unit 24, a display unit 25, an operation unit 26, a control unit 27 that controls these units, and each of these units. And a power supply unit 28 for supplying power to the power supply.
- the receiving unit 21 receives the image data and related information wirelessly transmitted from the capsule endoscope 10 via the receiving antenna unit 3 having a plurality (eight in FIG. 1) of receiving antennas 3a to 3h.
- Each of the receiving antennas 3a to 3h is realized by using, for example, a loop antenna or a dipole antenna, and is disposed at a predetermined position on the external surface of the subject 2.
- the signal processing unit 22 performs predetermined signal processing on the image data received by the receiving unit 21.
- the memory 23 stores the image data subjected to signal processing in the signal processing unit 22 and related information.
- the data transmission / reception unit 24 is an interface that can be connected to a communication line such as USB, wired LAN, or wireless LAN.
- the data transmission / reception unit 24 transmits the image data and related information stored in the memory 23 to the image processing device 30 when connected to the image processing device 30 in a communicable state.
- the display unit 25 displays an in-vivo image or the like based on the image data received from the capsule endoscope 10.
- the operation unit 26 is an input device used when the user inputs various setting information and instruction information to the receiving device 20.
- Such a receiving device 20 is discharged while passing through the digestive tract while the capsule endoscope 10 is imaging (for example, after the capsule endoscope 10 is swallowed by the subject 2). Until the subject 2 is worn and carried. During this time, the receiving device 20 further adds related information such as reception intensity information and reception time information at the receiving antennas 3a to 3h to the image data received via the receiving antenna unit 3, and the image data and the related information. Is stored in the memory 23.
- the receiving device 20 is removed from the subject 2 and set in the cradle 20a connected to the image processing device 30.
- the receiving device 20 is connected to the image processing device 30 in a communicable state, and transfers (downloads) the image data and the related information stored in the memory 23 to the image processing device 30.
- the image processing device 30 is configured using a workstation including a display device 30a such as a CRT display or a liquid crystal display.
- the image processing apparatus 30 includes an input unit 31, a data transmission / reception unit 32, a storage unit 33, an image processing unit 34, an output unit 35, and a control unit 36 that controls these units in an integrated manner.
- the input unit 31 is realized by an input device such as a keyboard, a mouse, a touch panel, and various switches.
- the input unit 31 receives input of information and commands according to user operations.
- the data transmission / reception unit 32 is an interface that can be connected to a communication line such as a USB or a wired LAN or a wireless LAN, and includes a USB port and a LAN port.
- the data transmission / reception unit 32 is connected to the reception device 20 via the cradle 20a connected to the USB port, and transmits / receives data to / from the reception device 20.
- the storage unit 33 is realized by a semiconductor memory such as a flash memory, a RAM, or a ROM, a recording medium such as an HDD, an MO, a CD-R, or a DVD-R, and a drive device that drives the recording medium.
- the storage unit 33 is a program for operating the image processing apparatus 30 to execute various functions, various information used during the execution of the program, and image data and related information acquired via the receiving apparatus 20 Memorize etc.
- the image processing unit 34 is realized by hardware such as a CPU, and reads a predetermined program stored in the storage unit 33, thereby creating a predetermined in-vivo image corresponding to the image data stored in the storage unit 33.
- the image processing is performed. More specifically, the image processing unit 34 performs predetermined image processing such as demosaicing, density conversion (gamma conversion, etc.), smoothing (noise removal, etc.), sharpening (edge enhancement, etc.) on the image data.
- An image (spectral image) for each color component using each of R data, G data, and B data, and a color image using all image data are created.
- the image processing unit 34 also executes processing for creating a composite image using the created spectral image and color image.
- the output unit 35 outputs various images created by the image processing unit 34 and other information to an external device such as the display device 30a for display.
- the control unit 36 is realized by hardware such as a CPU, and reads various programs stored in the storage unit 33 to thereby input a signal input via the input unit 31 or image data input from the data transmission / reception unit 32. Based on the above, instructions to each unit constituting the image processing apparatus 30 and data transfer are performed, and the overall operation of the image processing apparatus 30 is comprehensively controlled.
- FIG. 8 is a diagram for explaining a control operation by the control unit 13 of the capsule endoscope 10.
- the control unit 13 causes the imaging unit 11 to perform an imaging operation at a preset imaging cycle (T 1 + T 2 ). Further, in synchronization with this imaging operation, the control unit 13 causes the illumination unit 12 to emit light with two different types of spectral characteristics by changing the drive current during the imaging period T 1 . That is, by driving the illumination unit 12 with the drive current I 1 after the start of the imaging period T 1 , light having a spectral characteristic C 1 (see FIG. 6) having a strong blue component with respect to the yellow component (hereinafter also referred to as illumination light). Thus, the subject 2 is illuminated for a predetermined light emission period t 1 (first light emission state).
- the control unit 13 drives the illumination unit 12 with the drive current I 2 (I 2 ⁇ I 1 ) after the light emission period t 1 has elapsed, so that the spectral characteristics of the yellow component and the blue component having the same intensity are obtained.
- each pixel of the image sensor included in the imaging unit 11 receives the reflected light from the subject 2 of the illumination light having the spectral characteristics C 1, and red (R) and green (G). , Image information (charge) of each color component of blue (B) is accumulated. Further, during the subsequent light emission period t 2 , each pixel of the image sensor receives the reflected light from the subject 2 of the illumination light having the spectral characteristic C 2 and similarly accumulates the imaging information.
- the imaging unit 11 reads the stored imaging information for each imaging period T 1 and outputs image data (R data, G data, B data) corresponding to each color component.
- the output image data is stored in the memory 14.
- FIG. 9A and 9B are schematic diagrams illustrating data levels of image data output by the imaging unit 11 for each imaging period T 1 .
- FIG. 9A shows a case where the spectral characteristics obtained by changing the spectral characteristic C2 from the spectral characteristics C1 during the imaging period T 1.
- FIG. 9B shows, for comparison, a case where the spectral characteristics are kept constant in the imaging period T 1 while maintaining the spectral characteristics C2.
- the short wavelength side color component including the wavelength ⁇ 1 (hereinafter referred to as the short wavelength side component) and the wavelength ⁇ 2 are included.
- the subject 2 is illuminated with light having the same emission intensity as the color component on the long wavelength side (hereinafter referred to as the long wavelength side component).
- the subject 2 tends to absorb the absorption wavelength of 415 nm of hemoglobin and the short wavelength side component in the vicinity thereof.
- the intensity of the short wavelength side component is greatly attenuated compared to the long wavelength side component.
- the image data output from the imaging unit 11 every imaging period T 1 for R data corresponding to the long wavelength side component, the level of B data corresponding to the short wavelength side component is very low End up.
- the emission intensity of the shorter wavelength side component is resistant to long-wavelength side component
- the subject 2 is illuminated with light. Therefore, even if the short wavelength side component is absorbed in the subject 2, the short wavelength side component remains sufficiently in the reflected light from the subject 2. Further, during the subsequent light emission period t 2, the subject 2 is illuminated with light having the same emission intensity of the short wavelength side component and the long wavelength side component. Therefore, in the reflected light, but rather than the light emission period t 1 is short intensity of the long wavelength side component in the opposite becomes relatively stronger than the light emission period t 1. After all, in the entire imaging period T 1 , the level of B data in the image data output from the imaging unit 11 can be improved as compared with the case of FIG. 9B.
- the drive current I 1 is preferably about three times that of I 2 . Specifically, when the driving current of a white LED normally used in a general capsule endoscope is 5 mA, the driving current I 2 is set to about 5 mA, and the driving current I 1 is set to about 15 mA.
- the specific distribution of the light emission periods t 1 and t 2 is not particularly limited as long as t 1 > t 2 , and the ratio of the drive currents I 1 and I 2 or the level of B data to be improved in the image data. It is good to set according to.
- the image data acquired in this way is wirelessly transmitted from the transmission unit 15 and taken into the image processing device 30 via the reception device 20.
- the image processing unit 34 performs predetermined image processing on the captured image data, and creates a spectral image composed of each color component of red (R), green (G), and blue (B). Further, the image processing unit 34 creates a color in-vivo image composed of R, G, and B color components by adding (or weighted addition) the pixel values of corresponding pixels between these spectral images. Also good.
- the color temperature of the light that irradiates the subject 2 changes as compared with the case where the drive current of the illumination unit 12 is constant. For this reason, image processing for reducing the influence of changes in color temperature, such as white balance processing, may be performed on the image data.
- the level of the B data corresponding to the wavelength component on the short wavelength side that is easily absorbed by the living body It is possible to acquire image data that is improved compared to the prior art. Therefore, by using such image data, it is possible to create a bright (high luminance) spectral image composed of B data. Further, by synthesizing such a spectral image and a spectral image of other color components, it is possible to create a color image in which the fine structure of the surface tissue in the subject 2 appears.
- two types of light having different light emission characteristics are sequentially generated during one imaging period.
- three or more types of light having different light emission characteristics may be sequentially generated. .
- FIG. 10 is a diagram for explaining a control operation executed by the control unit 13 in the second embodiment.
- 11A and 11B are schematic diagrams illustrating data levels of image data output each time the imaging unit 11 performs imaging.
- the control unit 13 When the power supply unit 17 of the capsule endoscope 10 is switched to the on state, the control unit 13 performs a series of imaging operations of imaging the imaging unit 11 twice at an imaging interval T 4 (T 4 ⁇ T 3 ). Is executed every period T 3 .
- specific numerical values of the period T 3 is not particularly limited, it may be set to the one frame in a general capsule endoscope time (e.g. 500 ms).
- the specific value of the imaging interval T 4 is not particularly limited, but may be set to, for example, about 1/8 to 1/15 (for example, about 30 ms to 60 ms) of the period T 3 .
- control unit 13 synchronizes with the imaging operation described above, and performs a series of light emitting operations in which the illumination unit 12 sequentially generates light having two different types of spectral characteristics at the imaging interval T 4 in a cycle T 3.
- the control unit 13 drives the illumination unit 12 with the drive current I 1 , so that light having the spectral characteristic C1 (see FIG. 6) is used for a predetermined light emission period t 3.
- the inside of the subject 2 is illuminated.
- control unit 13 drives the illumination unit 12 with the drive current I 2 (I 2 ⁇ I 1 ), so that predetermined light emission is performed with light having the spectral characteristic C2 (see FIG. 7).
- the control unit 13 drives the illumination unit 12 with the drive current I 2 (I 2 ⁇ I 1 ), so that predetermined light emission is performed with light having the spectral characteristic C2 (see FIG. 7).
- t 4 t 3 is set.
- the imaging unit 11 receives the reflected light from the subject 2 with light having a shorter short wavelength side component than the long wavelength side component in the first imaging within the period T 3 . Therefore, in the reflected light, despite the absorption in the subject 2, the absorption wavelength of hemoglobin and the intensity of the short wavelength side component in the vicinity thereof remain sufficiently. Therefore, in the image data output from the imaging unit 11, the data level of B data is relatively higher than that of R data, as shown in FIG. 11A.
- the imaging unit 11 receives reflected light from the subject 2 with light having the same intensity of the short wavelength side component and the long wavelength side component. In this reflected light, the intensity of the short wavelength side component is greatly attenuated by absorption in the subject 2. Therefore, in the image data output from the imaging unit 11, as shown in FIG. 11B, the data level of the B data is very low compared to the R data.
- the image data acquired in this way is wirelessly transmitted from the transmission unit 15 and taken into the image processing device 30 via the reception device 20.
- the transmission unit 15 may transmit image data every time imaging is performed, or may transmit image data acquired by imaging twice in one cycle T 3 collectively.
- the image processing unit 34 performs predetermined image processing on the captured image data, an image based on the image data acquired by the first imaging (spectral characteristic C1) (hereinafter referred to as a blue white image), 2 An image based on the image data acquired by the second imaging (spectral characteristic C2) (hereinafter simply referred to as a white image) is created. At this time, white balance processing or the like may be performed in order to reduce the influence of the change in color temperature in the light irradiated on the subject 2.
- the image processing unit 34 creates a histogram of pixel values (luminance values) of pixels in the image for each of the blue white image and the white image. At this time, it is preferable to normalize the luminance values of the blue white image and the white image in consideration of the first and second imaging conditions (light emission intensity, light emission time, etc. at each time). Then, the image processing unit 34 creates a composite image by replacing the pixel value of the pixel saturated in the white image with the pixel value of the corresponding pixel in the blue white image based on each histogram.
- the imaging interval T 4 is short between the blue-based white image and the white image acquired by two imagings in one cycle T 3, it is considered that almost the same region in the subject 2 is captured. be able to.
- a blue white image captured by light with a short wavelength side component is less saturated than a white image, so even a region saturated in a white image is saturated in a blue white image. It's likely not. Therefore, by executing the above-described image processing, it is possible to obtain a composite image that is appropriately expanded in gradation and free from blurring. Further, since the blue white image well reflects the fine structure of the surface tissue in the subject 2, there is an advantage that detailed information of the pixel area where the pixel value is replaced can be obtained.
- the pixel area where the pixel value is replaced may be appropriately selected by the user visually observing the white image displayed on the display device 30a.
- the image processing unit 34 uses the B data acquired under the light having the spectral characteristic C1 and the G data and the R data acquired under the light having the spectral characteristic C2, respectively. May be created.
- a spectral image of a sufficiently bright blue component can be obtained based on the G data.
- a composite image may be created by adding (or weighting addition) pixel values of corresponding pixels in the blue white image and the white image. In this case, it is possible to obtain a color image in which the level of B data is improved as compared with the conventional art.
- the number of times of imaging per cycle T 3 may be three or more.
- the spectral characteristics that is, the drive current of the illumination unit 12
- the spectral characteristics may be changed to three or more types according to the number of times of imaging.
- FIG. 12 is a diagram for explaining a control operation by the control unit 13 of the capsule endoscope 10 in the first modification.
- two types of light having different spectral characteristics are generated when imaging is performed twice within one period T 3.
- the driving current is made constant (for example, I 2 ) between the first and second times, and the second light emission period t 4 is set to be longer than the first light emission period (ie, exposure time) t 3. shorten.
- the amount of light that illuminates the subject 2 changes between the two imaging operations.
- two images having different gradations can be obtained in one cycle T 3 .
- the gradation is expanded appropriately. A composite image can be obtained.
- Modification 2 In the first modification, when the amount of light that illuminates the subject 2 is changed between two imaging operations within one period T 3 , the light emission period may be constant and the light intensity may be changed. good. In this case, the drive current of the illumination unit 12 may be varied within a range where the spectral characteristics of the generated light do not change significantly.
- Various combinations can be made by appropriately combining a plurality of components disclosed in the embodiments and modifications. Can be formed.
- some constituent elements may be excluded from all the constituent elements shown in each embodiment or modification, or may be formed by appropriately combining the constituent elements shown in different embodiments or modifications. May be.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Radiology & Medical Imaging (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Endoscopes (AREA)
Abstract
Description
本発明は、被検体内に導入されて該被検体内を撮像することにより画像情報を取得するカプセル型内視鏡、及びカプセル型内視鏡が取得した画像情報を用いて被検体内の画像を作成するカプセル型内視鏡システムに関する。 The present invention relates to a capsule endoscope that is introduced into a subject and acquires image information by imaging the inside of the subject, and an image in the subject using image information acquired by the capsule endoscope. The present invention relates to a capsule endoscope system that creates
被検体内を撮像する内視鏡の分野においては、複数種類の波長成分の光(即ち、複数色の色光)を被検体に照射して撮像を行うことにより、各色成分の分光画像を取得する技術が知られている。一例として、狭帯域バンドパスフィルタを用いて照明光の波長帯域を狭帯域化した狭帯域フィルタ内蔵電子内視鏡システム(Narrow Band Imaging:以下、NBIという)が挙げられる。NBIにおいては、狭帯域バンドパスフィルタによって狭帯域化した赤(R)、緑(G)、青(B)の各色光を被検体内の臓器等に順次照射する面順次方式によって各色成分の分光画像を撮像する。 In the field of endoscopes for imaging the inside of a subject, a spectral image of each color component is acquired by irradiating the subject with light of a plurality of types of wavelength components (that is, color lights of a plurality of colors). Technology is known. As an example, there is a narrow band filter built-in electronic endoscope system (hereinafter referred to as NBI) in which the wavelength band of illumination light is narrowed using a narrow band pass filter. In NBI, each color component is separated by a surface-sequential method in which red (R), green (G), and blue (B) light beams narrowed by a narrow-band bandpass filter are sequentially irradiated to an organ or the like in a subject. Take an image.
また、近年では、被検体内に嚥下され、消化管内を移動しながら撮像を行うカプセル型内視鏡においても、各色成分の分光画像を取得する技術が検討されている(例えば、特許文献1参照)。 In recent years, a technique for acquiring a spectral image of each color component has been studied even in a capsule endoscope that is swallowed into a subject and performs imaging while moving in the digestive tract (see, for example, Patent Document 1). ).
ところで、被検体内においては、ヘモグロビンの吸収帯域である波長415nm及びその近傍の色成分(即ち、青色成分)が吸収され易い。一方、カプセル型内視鏡においては、従来、光源として白色LEDが用いられている。このため、被検体内に照射した白色光の反射光に基づく画像データにおいては、被検体内における吸収が比較的少ない赤色成分のデータと比べて青色成分のデータのレベルが非常に低くなり、暗い分光画像しか得ることができなかった。しかしながら、青色成分のデータは、被検体内の表層組織の微細な構造をよく反映しているため、青色成分のデータのレベルが高い画像の取得が望まれている。 Incidentally, in the subject, a wavelength component of 415 nm, which is an absorption band of hemoglobin, and a color component in the vicinity thereof (that is, a blue component) are easily absorbed. On the other hand, in a capsule endoscope, a white LED is conventionally used as a light source. For this reason, in the image data based on the reflected light of the white light irradiated in the subject, the level of the blue component data is very low and dark compared to the red component data that has relatively little absorption in the subject. Only spectral images could be obtained. However, since the blue component data well reflects the fine structure of the surface tissue in the subject, it is desired to obtain an image with a high level of blue component data.
青色成分のデータのレベルを高くするためには、上述したNBIのように、白色光を狭帯域化し、各色成分の光を被検体内に順次照射することも考えられる。しかしながら、被検体に嚥下させるカプセル型内視鏡に狭帯域フィルタ等を設けることは、大きさの制約があり困難である。 In order to increase the level of blue component data, it is also conceivable to narrow the band of white light and sequentially irradiate the light of each color component into the subject, as in the NBI described above. However, it is difficult to provide a narrow band filter or the like in a capsule endoscope that is swallowed by a subject due to size restrictions.
本発明は、上記に鑑みてなされたものであって、所望の色成分のデータレベルの高い画像を取得することができるカプセル型内視鏡及びカプセル型内視鏡システムを提供することを目的とする。 The present invention has been made in view of the above, and an object of the present invention is to provide a capsule endoscope and a capsule endoscope system that can acquire an image with a high data level of a desired color component. To do.
上述した課題を解決し、目的を達成するために、本発明に係るカプセル型内視鏡は、電流が流れることにより第1の波長成分を含む光を発生する発光素子と、前記第1の波長成分を含む光を吸収することにより前記第1の波長成分とは異なる第2の波長成分を含む光を発生する蛍光体とを有し、前記第1及び第2の波長成分を含む照明光を発光可能な照明手段と、前記照明手段が発生した照明光により照明された被検体内を撮像して、画像データを取得する撮像手段と、前記撮像手段の撮像動作と同期して、前記照明手段に流す電流の大きさを変化させることにより、前記照明手段が発生する照明光の分光特性を切り替える制御を行う制御手段と、を備えることを特徴とする。 In order to solve the above-described problems and achieve the object, a capsule endoscope according to the present invention includes a light-emitting element that generates light including a first wavelength component when a current flows, and the first wavelength. A phosphor that generates light including a second wavelength component different from the first wavelength component by absorbing light including the component, and includes illumination light including the first and second wavelength components. Illuminating means capable of emitting light, imaging means for capturing an image of a subject illuminated by illumination light generated by the illuminating means, and acquiring image data; and the illuminating means in synchronization with an imaging operation of the imaging means Control means for controlling the switching of the spectral characteristics of the illumination light generated by the illumination means by changing the magnitude of the current passed through the illumination means.
上記カプセル型内視鏡において、前記制御手段は、静止画撮像の1回の露光期間中に、前記照明手段が発生する照明光の分光特性を切り替えることを特徴とする。 In the capsule endoscope, the control unit switches a spectral characteristic of illumination light generated by the illumination unit during a single exposure period of still image capturing.
上記カプセル型内視鏡において、前記制御手段は、前記撮像手段による撮像動作が開始した際に、第1の分光特性を有する光を所定期間発光させた後、前記第1の分光特性とは異なる第2の分光特性を有する光を所定期間発光させることを特徴とする。 In the capsule endoscope, the control unit is different from the first spectral characteristic after emitting light having the first spectral characteristic for a predetermined period when the imaging operation by the imaging unit is started. The light having the second spectral characteristic is emitted for a predetermined period.
上記カプセル型内視鏡において、前記第1の分光特性と前記第2の分光特性とは、前記照明手段が発生する照明光に含まれる前記第1の波長成分と前記第2の波長成分との強度比が異なることを特徴とする。 In the capsule endoscope, the first spectral characteristic and the second spectral characteristic are the first wavelength component and the second wavelength component included in the illumination light generated by the illumination unit. It is characterized by different intensity ratios.
上記カプセル型内視鏡において、前記第1の波長成分の中心波長は、前記第2の波長成分の中心波長よりも短く、前記第1の分光特性において、前記第2の波長成分に対する前記第1の波長成分の強度比は1より大きく、前記第2の分光特性において、前記第2の波長成分に対する前記第1の波長成分の強度比は、前記第1の分光特性における前記強度比より小さいことを特徴とする。 In the capsule endoscope, a center wavelength of the first wavelength component is shorter than a center wavelength of the second wavelength component, and the first spectral characteristic has a first wavelength with respect to the second wavelength component. In the second spectral characteristic, the intensity ratio of the first wavelength component to the second wavelength component is smaller than the intensity ratio in the first spectral characteristic. It is characterized by.
上記カプセル型内視鏡において、前記第1の分光特性を有する光の発光期間は、前記第2の分光特性を有する光の発光期間よりも長いことを特徴とする。 In the capsule endoscope, a light emission period of the light having the first spectral characteristic is longer than a light emission period of the light having the second spectral characteristic.
上記カプセル型内視鏡において、前記第1の波長成分は、400nm~470nmのいずれかであることを特徴とする。 In the capsule endoscope, the first wavelength component is any of 400 nm to 470 nm.
本発明に係るカプセル型内視鏡システムは、上記カプセル型内視鏡と、前記カプセル型内視鏡が取得した画像データを処理する画像処理装置と、を備えることを特徴とする。 A capsule endoscope system according to the present invention includes the capsule endoscope and an image processing apparatus that processes image data acquired by the capsule endoscope.
上記カプセル型内視鏡システムにおいて、前記撮像手段は、赤、緑、青の各色成分の画像データを取得し、前記画像処理装置は、前記画像データに基づき、前記各色成分の分光画像を作成することを特徴とする。 In the capsule endoscope system, the imaging unit acquires image data of each color component of red, green, and blue, and the image processing device creates a spectral image of each color component based on the image data. It is characterized by that.
また、本発明に係るカプセル型内視鏡は、電流が流れることにより第1の波長成分を含む光を発生する発光素子と、前記第1の波長成分を含む光を吸収することにより前記第1の波長成分とは異なる第2の波長成分を含む光を発生する蛍光体とを有し、前記第1及び第2の波長成分を含む照明光を発光可能な照明手段と、前記照明手段が発生した照明光により照明された被検体内を撮像して、画像データを取得する撮像手段と、前記撮像手段の撮像動作と同期して、前記照明手段に流す電流の大きさを変化させることにより、前記照明手段が発生する照明光の分光特性を切り替える制御を行う制御手段と、を備え、前記制御手段は、前記撮像手段に対し、所定の撮像間隔で、分光特性が互いに異なる複数種類の照明光の下で複数回の撮像をそれぞれ行う一連の撮像動作を、所定の周期で繰り返し実行させることを特徴とする。 In addition, the capsule endoscope according to the present invention has a light emitting element that generates light including a first wavelength component when current flows, and the first endoscope that absorbs light including the first wavelength component. A phosphor that emits light including a second wavelength component different from the wavelength component of the light source, and capable of emitting illumination light including the first and second wavelength components; and the illumination unit generates By imaging the inside of the subject illuminated by the illuminated light and acquiring image data, and by changing the magnitude of the current flowing through the illumination means in synchronization with the imaging operation of the imaging means, Control means for performing control for switching the spectral characteristics of the illumination light generated by the illumination means, and the control means provides the imaging means with a plurality of types of illumination light having different spectral characteristics at a predetermined imaging interval. Take multiple shots under A series of imaging operations performed, respectively is characterized in that it is performed repeatedly at a predetermined cycle.
上記カプセル型内視鏡において、前記複数種類の照明光は、前記照明手段が発生する照明光に含まれる前記第1の波長成分と前記第2の波長成分との強度比が互いに異なる照明光であることを特徴とする。 In the capsule endoscope, the plurality of types of illumination light are illumination light having different intensity ratios between the first wavelength component and the second wavelength component included in the illumination light generated by the illumination unit. It is characterized by being.
上記カプセル型内視鏡において、前記第1の波長成分の中心波長は、前記第2の波長成分の中心波長よりも短く、前記制御手段は、前記撮像手段に対し、前記第2の波長成分に対する前記第1の波長成分の強度比が1より大きい第1の分光特性を有する照明光の下での第1回目の撮像と、前記第2の波長成分に対する前記第1の波長成分の強度比が前記第1の分光特性における前記強度比より小さい第2の分光特性を有する照明光の下での第2回目の撮像とを、前記撮像間隔で実行させることを特徴とする。 In the capsule endoscope, a center wavelength of the first wavelength component is shorter than a center wavelength of the second wavelength component, and the control unit is configured to control the imaging unit with respect to the second wavelength component. The first imaging under illumination light having a first spectral characteristic in which the intensity ratio of the first wavelength component is greater than 1, and the intensity ratio of the first wavelength component to the second wavelength component is A second imaging under illumination light having a second spectral characteristic smaller than the intensity ratio in the first spectral characteristic is performed at the imaging interval.
上記カプセル型内視鏡において、前記第1回目の撮像における露光時間は、前記第2回目の撮像における露光時間よりも長いことを特徴とする。 In the capsule endoscope, an exposure time in the first imaging is longer than an exposure time in the second imaging.
上記カプセル型内視鏡において、前記第1の波長成分は、400nm~470nmのいずれかであることを特徴とする。 In the capsule endoscope, the first wavelength component is any of 400 nm to 470 nm.
本発明に係るカプセル型内視鏡システムは、上記カプセル型内視鏡と、前記カプセル型内視鏡が取得した画像データを処理する画像処理装置と、を備えることを特徴とする。 A capsule endoscope system according to the present invention includes the capsule endoscope and an image processing apparatus that processes image data acquired by the capsule endoscope.
上記カプセル型内視鏡システムにおいて、前記画像処理装置は、前記複数回の撮像によりそれぞれ取得された画像データに基づき、複数の画像をそれぞれ作成し、前記複数の画像の間で対応する画素の画素値を加算することにより合成画像を作成することを特徴とする。 In the capsule endoscope system, the image processing device creates a plurality of images based on the image data respectively acquired by the plurality of times of imaging, and corresponding pixels of the plurality of images A composite image is created by adding values.
上記カプセル型内視鏡システムにおいて、前記画像処理装置は、前記複数回の撮像によりそれぞれ取得された画像データに基づき、複数の画像をそれぞれ作成し、前記複数の画像のうちのいずれかの画像内において飽和している画素の画素値を、前記複数の画像のうちの他の画像内の対応する画素の画素値に置き換えることにより合成画像を作成することを特徴とする。
In the capsule endoscope system, the image processing device creates a plurality of images based on the image data respectively acquired by the plurality of times of imaging, and includes any one of the plurality of images. A composite image is created by replacing the pixel value of the pixel saturated in
上記カプセル型内視鏡システムにおいて、前記撮像手段は、赤、緑、青の各色成分の画像データを取得し、前記画像処理装置は、前記複数回の撮像によりそれぞれ取得された画像データに基づき、前記各色成分の分光画像を作成することを特徴とする。 In the capsule endoscope system, the imaging unit acquires image data of each color component of red, green, and blue, and the image processing device is based on the image data acquired by the plurality of imaging operations, A spectral image of each of the color components is created.
本発明によれば、撮像動作と同期して、被検体内を照明する光の分光特性を切り替えるので、所望の色成分のデータレベルの高い画像を取得することが可能となる。 According to the present invention, since the spectral characteristics of the light illuminating the inside of the subject are switched in synchronization with the imaging operation, it is possible to acquire an image having a high data level of a desired color component.
以下に、本発明に係るカプセル型内視鏡及びカプセル型内視鏡システムの実施の形態を、図面に基づいて詳細に説明する。なお、この実施の形態によりこの発明が限定されるものではない。また、各図面の記載において、同一部分には同一の符号を付して示している。 Hereinafter, embodiments of a capsule endoscope and a capsule endoscope system according to the present invention will be described in detail based on the drawings. Note that the present invention is not limited to the embodiments. Moreover, in description of each drawing, the same code | symbol is attached | subjected and shown to the same part.
(実施の形態1)
図1は、本発明の実施の形態1に係るカプセル型内視鏡システムの概略構成を示す模式図である。図1に示すように、実施の形態1に係るカプセル型内視鏡システム1は、被検体2内に導入されて該被検体2内を撮像することにより画像データを取得し、無線信号に重畳して送信するカプセル型内視鏡10と、カプセル型内視鏡10から送信された無線信号を、被検体2に装着された受信アンテナユニット3を介して受信する受信装置20と、カプセル型内視鏡10が取得した画像データを、受信装置20を介して取り込み、該画像データを用いて被検体2内の画像を作成する画像処理装置30とを備える。
(Embodiment 1)
FIG. 1 is a schematic diagram showing a schematic configuration of a capsule endoscope system according to
図2は、カプセル型内視鏡システム1を示すブロック図である。
カプセル型内視鏡10は、被検体2が嚥下可能な大きさのカプセル形状の筐体に撮像素子等の各種部品を内蔵した装置であり、被検体2内を撮像する撮像部11と、被検体2内を照明する照明部12と、制御部13と、メモリ14と、送信部15と、アンテナ16と、電源部17とを備える。
FIG. 2 is a block diagram showing the
The
撮像部11は、例えば、受光面に結像された光学像から被検体2内を表す撮像信号を生成して出力するCCDやCMOS等の撮像素子と、該撮像素子の受光面側に配設された対物レンズ等の光学系とを含む。撮像素子は、赤(R)、緑(G)、青(B)の各色成分(波長成分)に対応する画像データ(Rデータ、Gデータ、Bデータ)を出力するカラーセンサである。 For example, the imaging unit 11 generates an imaging signal representing the inside of the subject 2 from an optical image formed on the light receiving surface and outputs it, such as a CCD or CMOS, and is disposed on the light receiving surface side of the imaging device. And an optical system such as an objective lens. The imaging device is a color sensor that outputs image data (R data, G data, B data) corresponding to each color component (wavelength component) of red (R), green (G), and blue (B).
照明部12は、白色光を放射する白色LED(Light Emitting Diode)を有する。ここで、白色LEDの発光方式には、青色LED及び補色である黄色の蛍光体を用いる方式(以下、擬似白色方式という)、紫色(又は近紫外)LED及び赤色・緑色・青色の3種の蛍光体を用いる方式、並びに、赤色・緑色・青色でそれぞれ発光する3種のLEDを組み合わせる方式とが知られている。実施の形態1においては、これらの方式のうち、擬似白色方式の白色LEDを用いる。
The
図3は、擬似白色方式の白色LEDの発光の仕組みを説明するための模式図である。図3に示すように、白色LEDは、基板121と、該基板121上に配置されたキャビティ122と、基板121上に実装された青色LED123と、キャビティ122内に配置されて青色LED123を覆う蛍光体124と、これらの各部を封止する透明樹脂125とを備える。青色LED123は、例えば窒化ガリウム結晶を含み、電流が流れることにより、中心波長λ1(λ1は例えば400nm~470nm程度)の青色光を発生する(図4A参照)。一方、蛍光体124は、例えばYAG(イットリウム・アルミニウム・ガーネット)系の黄色の蛍光剤をエポキシやシリコン樹脂等の透明の樹脂材料に混合したものであり、青色LED123が発光した青色光により励起され、中心波長λ2(λ2>λ1、λ2は例えば520nm~640nm程度)の黄色光(蛍光)を発生する(図4B参照)。
FIG. 3 is a schematic diagram for explaining a mechanism of light emission of the pseudo white type white LED. As shown in FIG. 3, the white LED includes a
このような白色LEDに駆動電流を流すと、青色LED123から発生した青色光の一部が蛍光体124を透過し、残りが蛍光体124に吸収される。蛍光体124は、吸収した青色光により励起されて黄色光を発生する。その結果、蛍光体124を透過した青色光と蛍光体124が発生した黄色光とが混色され、白色光が放射される。
When a driving current is passed through such a white LED, part of the blue light generated from the
図5は、混色の原理を説明するための色度図である。色度図の境界線(端部)上の各座標は純色の色成分を示し、境界線に記された数値は各色成分の波長を示す。また、境界線の内部の各座標は混色を示す。このような色度図において、中央付近の白色領域Wを通る直線(例えば直線L)の両端に示す色成分(例えば波長λ1、λ2)を所定範囲の比率で混色することにより、白色光を生成することができる。 FIG. 5 is a chromaticity diagram for explaining the principle of color mixing. Each coordinate on the boundary line (edge) of the chromaticity diagram indicates a pure color component, and a numerical value written on the boundary line indicates a wavelength of each color component. Each coordinate inside the boundary line indicates a color mixture. In such a chromaticity diagram, white light is mixed by mixing color components (for example, wavelengths λ 1 and λ 2 ) shown at both ends of a straight line (for example, a straight line L) passing through a white region W near the center at a ratio in a predetermined range. Can be generated.
図6及び図7は、白色LEDが放射する白色光の分光特性を模式的に示すグラフであり、図6は、図7と比較して、白色LEDの駆動電流を強くした場合を示している。ここで、青色LED123が発光した青色光のうち、蛍光体124が吸収可能な光量には上限がある。このため、電流の強さを変化させても、蛍光体124が発生する黄色光の強度はあまり変化しない。一方、駆動電流を強くすると、青色LED123から発生し、蛍光体124に吸収されずに透過する青色光の強度が強くなる。
6 and 7 are graphs schematically showing the spectral characteristics of white light emitted by the white LED, and FIG. 6 shows a case where the drive current of the white LED is increased compared to FIG. . Here, of the blue light emitted from the
そこで、白色LED(青色LED123)の駆動電流を変化させることにより、白色LEDが放射する白色光の分光特性を変化させることができる。具体的には、駆動電流を強くすることにより、図6に示すように、中心波長λ2の黄色成分よりも中心波長λ1の青色成分の発光強度が強い分光特性C1の白色光が放射される。即ち、黄色成分に対する青色成分の強度比が1よりも大きくなる。一方、駆動電流を弱くすることにより、図7に示すように、黄色成分に対する青色成分の強度比が、分光特性C1の場合よりも小さくなり、青色成分と黄色成分の発光強度が同程度(強度比が例えば1程度)である分光特性C2の白色光が放射される。 Therefore, by changing the drive current of the white LED (blue LED 123), the spectral characteristics of the white light emitted by the white LED can be changed. Specifically, by increasing the drive current, as shown in FIG. 6, white light having a spectral characteristic C1 in which the emission intensity of the blue component at the center wavelength λ 1 is stronger than that of the yellow component at the center wavelength λ 2 is emitted. The That is, the intensity ratio of the blue component to the yellow component is greater than 1. On the other hand, by reducing the drive current, as shown in FIG. 7, the intensity ratio of the blue component to the yellow component becomes smaller than that of the spectral characteristic C1, and the emission intensity of the blue component and the yellow component is approximately the same (intensity). White light having a spectral characteristic C2 having a ratio of about 1 is emitted.
このような駆動電流の調整による分光特性の制御は、概念的には、図5に示す色度図において、白色LEDが放射する光の色度を直線L上で変化させることに対応する。従って、白色LEDに流す駆動電流を変化させる範囲(分光特性C1、C2に対応する範囲)を適宜設定することにより、各色成分の混色比(強度比)が異なる白色光を放射させることができる。なお、駆動電流を変化させた場合、実際には、白色LEDが放射する白色光の色度は、色度図上において常に直線的に変化するわけではなく、白色LEDの特性に応じて若干カーブすることがある。 The control of the spectral characteristics by adjusting the driving current as described above conceptually corresponds to changing the chromaticity of the light emitted by the white LED on the straight line L in the chromaticity diagram shown in FIG. Therefore, by appropriately setting a range (range corresponding to the spectral characteristics C1 and C2) in which the drive current passed through the white LED is changed, it is possible to emit white light having different color mixture ratios (intensity ratios) of the respective color components. Note that when the drive current is changed, the chromaticity of the white light emitted by the white LED does not always change linearly on the chromaticity diagram, and is slightly curved according to the characteristics of the white LED. There are things to do.
また、実施の形態1において、青色LED123の発光波長λ1は特に限定されないが、生体内を撮像する場合には、ヘモグロビンの吸収波長415nm又はその近傍の青色光を発生するLEDを用いることが好ましい。
In the first embodiment, is not particularly limited emission wavelength lambda 1 of the
再び図2を参照すると、カプセル型内視鏡10は、撮像部11を駆動する撮像駆動回路及び照明部12を駆動する照明駆動回路等が形成された回路基板(図示せず)を内蔵している。撮像部11及び照明部12は、カプセル型内視鏡10の一端部から外側に視野を向けた状態で、この回路基板に固定されている。
Referring to FIG. 2 again, the
制御部13は、カプセル型内視鏡10内の各部を制御して、撮像部11に撮像動作を実行させると共に、撮像部11から出力された撮像信号に対してA/D変換及び所定の信号処理を施し、デジタルの画像データを取得する。より詳細には、制御部13は、撮像部11の1回の駆動期間(撮像期間)内に、照明部12の駆動電流の大きさを変化させることにより、照明部12の発光状態を切り替える制御を行う。なお、発光状態の切り替え制御は、例えば、照明駆動回路が備える抵抗をスイッチ回路によって切り替え、駆動電流の大きさを変化させることにより実行される。
The control unit 13 controls each unit in the
メモリ14は、制御部13が各種動作を実行するための実行プログラム及び制御プログラムを記憶する。また、メモリ14は、制御部13において信号処理が施された画像データ等を一時的に記憶しても良い。
The
送信部15及びアンテナ16は、メモリ14に記憶された画像データを関連情報と共に無線信号に重畳して外部に送信する。なお、関連情報には、カプセル型内視鏡10の個体を識別するために割り当てられた識別情報(例えばシリアル番号)等が含まれる。
The transmission unit 15 and the
電源部17は、ボタン電池等からなるバッテリと、該バッテリから電力を昇圧等する電源回路と、当該電源部17のオンオフ状態を切り替える電源スイッチとを含み、電源スイッチがオンとなった後、カプセル型内視鏡10内の各部に電力を供給する。なお、電源スイッチは、例えば外部の磁力によってオンオフが切り替えられるリードスイッチからなり、カプセル型内視鏡10の使用前(被検体2が嚥下する前)に、該カプセル型内視鏡10に外部から磁力を印加することによりオン状態に切り替えられる。
The
このようなカプセル型内視鏡10は、被検体2に嚥下された後、臓器の蠕動運動等によって被検体2の消化管内を移動しつつ、生体部位(食道、胃、小腸、及び大腸等)を所定の周期(例えば0.5秒周期)で順次撮像する。そして、この撮像動作により取得された画像データ及び関連情報を受信装置20に順次無線送信する。
Such a
受信装置20は、受信部21と、信号処理部22と、メモリ23と、データ送受信部24と、表示部25と、操作部26と、これらの各部を制御する制御部27と、これらの各部に電力を供給する電源部28とを備える。
The receiving
受信部21は、カプセル型内視鏡10から無線送信された画像データ及び関連情報を、複数(図1においては8個)の受信アンテナ3a~3hを有する受信アンテナユニット3を介して受信する。各受信アンテナ3a~3hは、例えばループアンテナ又はダイポールアンテナを用いて実現され、被検体2の体外表面上の所定位置に配置される。
The receiving
信号処理部22は、受信部21が受信した画像データに所定の信号処理を施す。
メモリ23は、信号処理部22において信号処理が施された画像データ及びその関連情報を記憶する。
The
The
データ送受信部24は、USB、又は有線LAN、無線LAN等の通信回線と接続可能なインタフェースである。データ送受信部24は、画像処理装置30と通信可能な状態で接続された際に、メモリ23に記憶された画像データ及び関連情報を画像処理装置30に送信する。
The data transmission / reception unit 24 is an interface that can be connected to a communication line such as USB, wired LAN, or wireless LAN. The data transmission / reception unit 24 transmits the image data and related information stored in the
表示部25は、カプセル型内視鏡10から受信した画像データに基づく体内画像等を表示する。
The
操作部26は、ユーザが当該受信装置20に対して各種設定情報や指示情報を入力する際に用いられる入力デバイスである。
The operation unit 26 is an input device used when the user inputs various setting information and instruction information to the receiving
このような受信装置20は、カプセル型内視鏡10により撮像が行われている間(例えば、カプセル型内視鏡10が被検体2に嚥下された後、消化管内を通過して排出されるまでの間)、被検体2に装着されて携帯される。受信装置20は、この間、受信アンテナユニット3を介して受信した画像データに、各受信アンテナ3a~3hにおける受信強度情報や受信時刻情報等の関連情報をさらに付加し、これらの画像データ及び関連情報をメモリ23に記憶させる。
Such a receiving
カプセル型内視鏡10による撮像の終了後、受信装置20は被検体2から取り外され、画像処理装置30と接続されたクレードル20aにセットされる。これにより、受信装置20は画像処理装置30と通信可能な状態で接続され、メモリ23に記憶された画像データ及び関連情報を画像処理装置30に転送(ダウンロード)する。
After the imaging by the
画像処理装置30は、例えば、CRTディスプレイや液晶ディスプレイ等の表示装置30aを備えたワークステーションを用いて構成される。画像処理装置30は、入力部31と、データ送受信部32と、記憶部33と、画像処理部34と、出力部35と、これらの各部を統括して制御する制御部36とを備える。
The
入力部31は、例えばキーボードやマウス、タッチパネル、各種スイッチ等の入力デバイスによって実現される。入力部31は、ユーザの操作に応じた情報や命令の入力を受け付ける。 The input unit 31 is realized by an input device such as a keyboard, a mouse, a touch panel, and various switches. The input unit 31 receives input of information and commands according to user operations.
データ送受信部32は、USB、又は有線LANや無線LAN等の通信回線と接続可能なインタフェースであり、USBポート及びLANポートを含んでいる。実施の形態1において、データ送受信部32は、USBポートに接続されるクレードル20aを介して受信装置20と接続され、受信装置20との間でデータの送受信を行う。
The data transmission /
記憶部33は、フラッシュメモリ、RAM、ROM等の半導体メモリや、HDD、MO、CD-R、DVD-R等の記録媒体及び該記録媒体を駆動する駆動装置等によって実現される。記憶部33は、画像処理装置30を動作させて種々の機能を実行させるためのプログラム、該プログラムの実行中に使用される各種情報、並びに、受信装置20を介して取得した画像データ及び関連情報等を記憶する。
The
画像処理部34は、CPU等のハードウェアによって実現され、記憶部33に記憶された所定のプログラムを読み込むことにより、記憶部33に記憶された画像データに対応する体内画像を作成するための所定の画像処理を施す。より詳細には、画像処理部34は、画像データに対し、デモザイキング、濃度変換(ガンマ変換等)、平滑化(ノイズ除去等)、鮮鋭化(エッジ強調等)等の所定の画像処理を施し、Rデータ、Gデータ、Bデータの各々を用いた色成分ごとの画像(分光画像)や、全ての画像データを用いたカラーの画像を作成する。また、画像処理部34は、作成した分光画像やカラー画像を用いた合成画像を作成する処理も実行する。
The image processing unit 34 is realized by hardware such as a CPU, and reads a predetermined program stored in the
出力部35は、画像処理部34が作成した各種画像やその他の情報を、表示装置30a等の外部装置に出力して表示させる。
The
制御部36は、CPU等のハードウェアによって実現され、記憶部33に記憶された各種プログラムを読み込むことにより、入力部31を介して入力された信号や、データ送受信部32から入力された画像データ等に基づいて、画像処理装置30を構成する各部への指示やデータの転送等を行い、画像処理装置30全体の動作を統括的に制御する。
The
次に、カプセル型内視鏡システム1の動作を説明する。図8は、カプセル型内視鏡10の制御部13による制御動作を説明するための図である。
Next, the operation of the
カプセル型内視鏡10の電源部17がオン状態に切り替えられると、制御部13は、撮像部11に対し、予め設定された撮像周期(T1+T2)で撮像動作を実行させる。また、制御部13は、この撮像動作と同期し、照明部12に対し、撮像期間T1中に駆動電流を変化させることにより、互いに異なる2種類の分光特性で発光させる。即ち、撮像期間T1の開始後、照明部12を駆動電流I1で駆動することにより、黄色成分に対して青色成分が強い分光特性C1(図6参照)を有する光(以下、照明光ともいう)で、所定の発光期間t1、被検体2内を照明する(第1の発光状態)。
When the
続いて、制御部13は、発光期間t1の経過後、照明部12を駆動電流I2(I2<I1)で駆動することにより、黄色成分と青色成分の強度が同程度の分光特性C2(図7参照)を有する光(同上)で、所定の発光期間t2(t1+t2=T1)、被検体2内を照明する(第2の発光状態)。
Subsequently, the control unit 13 drives the
これより、発光期間t1の間、撮像部11が備える撮像素子の各画素は、分光特性C1を有する照明光の被検体2からの反射光を受光し、赤(R)、緑(G)、青(B)の各色成分の撮像情報(電荷)を蓄積する。また、その後の発光期間t2の間、撮像素子の各画素は、分光特性C2を有する照明光の被検体2からの反射光を受光し、同様に撮像情報を蓄積する。撮像部11は、撮像期間T1ごとに、蓄積した撮像情報を読み出し、各色成分に対応する画像データ(Rデータ、Gデータ、Bデータ)を出力する。出力された画像データは、メモリ14に記憶される。
Accordingly, during the light emission period t 1 , each pixel of the image sensor included in the imaging unit 11 receives the reflected light from the
図9A及び図9Bは、撮像期間T1ごとに撮像部11が出力する画像データのデータレベルを示す模式図である。このうち、図9Aは、撮像期間T1中に分光特性を分光特性C1から分光特性C2を変化させた場合を示している。一方、図9Bは、撮像期間T1において分光特性を分光特性C2のまま一定に保った場合を、比較のために示している。 9A and 9B are schematic diagrams illustrating data levels of image data output by the imaging unit 11 for each imaging period T 1 . Of these, FIG. 9A shows a case where the spectral characteristics obtained by changing the spectral characteristic C2 from the spectral characteristics C1 during the imaging period T 1. On the other hand, FIG. 9B shows, for comparison, a case where the spectral characteristics are kept constant in the imaging period T 1 while maintaining the spectral characteristics C2.
図9Bに示すように、撮像期間T1の間に分光特性C2を変化させなかった場合、波長λ1を含む短波長側の色成分(以下、短波長側成分という)と波長λ2を含む長波長側の色成分(以下、長波長側成分という)との発光強度が同程度の光によって被検体2が照明される。ここで、上述したように、被検体2においてはヘモグロビンの吸収波長415nm及びその近傍の短波長側成分が吸収され易い。このため、被検体2からの反射光においては、長波長側成分と比べて短波長側成分の強度が大きく減衰している。その結果、撮像期間T1ごとに撮像部11から出力される画像データにおいては、長波長側成分に対応するRデータに対して、短波長側成分に対応するBデータのレベルが非常に低くなってしまう。
As shown in FIG. 9B, when the spectral characteristic C2 is not changed during the imaging period T 1 , the short wavelength side color component including the wavelength λ 1 (hereinafter referred to as the short wavelength side component) and the wavelength λ 2 are included. The
それに対し、図9Aに示すように、撮像期間T1の間に分光特性を変化させた場合、まず、発光期間t1の間、長波長側成分に対して短波長側成分の発光強度が強い光によって被検体2が照明される。そのため、被検体2内において短波長側成分が吸収されたとしても、被検体2からの反射光には短波長側成分が十分に残っている。また、続く発光期間t2の間、短波長側成分と長波長側成分との発光強度が同程度の光によって被検体2が照明される。そのため、反射光においては、発光期間t1よりは短期間であるが、発光期間t1とは反対に長波長側成分の強度が相対的に強くなる。結局、撮像期間T1全体では、図9Bの場合と比較して、撮像部11から出力される画像データにおけるBデータのレベルを改善することができる。
In contrast, as shown in FIG. 9A, when changing the spectral characteristic between the imaging period T 1, first, during the light emission period t 1, the emission intensity of the shorter wavelength side component is resistant to long-wavelength side component The
ここで、駆動電流I1、I2の具体的な数値は、白色LEDを構成する青色LED123及び蛍光体124の特性や、画像データにおいて改善したいBデータのレベルによって異なるが、一例として、駆動電流I2に対して駆動電流I1を3倍程度にすると良い。具体的には、一般的なカプセル型内視鏡内で通常用いられる白色LEDの駆動電流が5mAである場合、駆動電流I2を通常の約5mAとし、駆動電流I1を約15mAにする。
Here, specific values of the drive currents I 1 and I 2 vary depending on the characteristics of the
また、発光期間t1、t2については、t1>t2であれば具体的な配分は特に限定されず、駆動電流I1、I2の比率や、画像データにおいて改善したいBデータのレベルに応じて設定すると良い。例えば、駆動電流の比率をI1:I2=3:1とする場合、発光期間の配分をt1:t2=3:1程度にすると良い。このように、減衰し易い短波長側成分を強くする時間を長くすることにより、例えば図9Aに示すようなデータレベルの比で、各色成分のデータを取得することができる。 Further, the specific distribution of the light emission periods t 1 and t 2 is not particularly limited as long as t 1 > t 2 , and the ratio of the drive currents I 1 and I 2 or the level of B data to be improved in the image data. It is good to set according to. For example, when the drive current ratio is I 1 : I 2 = 3: 1, the distribution of the light emission period is preferably about t 1 : t 2 = 3: 1. In this way, by increasing the time for strengthening the short wavelength side component that is easily attenuated, the data of each color component can be acquired at a data level ratio as shown in FIG. 9A, for example.
このようにして取得された画像データは、送信部15から無線送信され、受信装置20を介して画像処理装置30に取り込まれる。画像処理部34は、取り込んだ画像データに所定の画像処理を施し、赤(R)、緑(G)、青(B)の各色成分からなる分光画像を作成する。さらに、画像処理部34は、これらの分光画像の間で対応する画素の画素値を加算(又は重み付け加算)することにより、R、G、Bの各色成分からなるカラーの体内画像を作成しても良い。
The image data acquired in this way is wirelessly transmitted from the transmission unit 15 and taken into the
なお、実施の形態1においては、照明部12の駆動電流を一定にする場合に対し、被検体2を照射する光の色温度が変化している。そのため、画像データに対し、ホワイトバランス処理等の色温度の変化の影響を低減する画像処理を施しても良い。
In the first embodiment, the color temperature of the light that irradiates the subject 2 changes as compared with the case where the drive current of the
以上説明したように、実施の形態1によれば、白色LEDの分光特性を1回の撮像期間中に変化させるので、生体に吸収され易い短波長側の波長成分に対応するBデータのレベルが従来よりも改善された画像データを取得することができる。従って、そのような画像データを用いることにより、Bデータからなる明るい(輝度の高い)分光画像を作成することができる。また、そのような分光画像と他の色成分の分光画像とを合成することにより、被検体2内の表層組織の微細構造が現れたカラー画像を作成することも可能となる。
As described above, according to the first embodiment, since the spectral characteristics of the white LED are changed during one imaging period, the level of the B data corresponding to the wavelength component on the short wavelength side that is easily absorbed by the living body. It is possible to acquire image data that is improved compared to the prior art. Therefore, by using such image data, it is possible to create a bright (high luminance) spectral image composed of B data. Further, by synthesizing such a spectral image and a spectral image of other color components, it is possible to create a color image in which the fine structure of the surface tissue in the
なお、上記実施の形態1においては、1回の撮像期間中に発光特性が互いに異なる2種類の光を順次発生させたが、発光特性が互いに異なる3種類以上の光を順次発生させても良い。 In the first embodiment, two types of light having different light emission characteristics are sequentially generated during one imaging period. However, three or more types of light having different light emission characteristics may be sequentially generated. .
(実施の形態2)
次に、本発明の実施の形態2について説明する。
実施の形態2に係るカプセル型内視鏡及びカプセル型内視鏡システムの構成は実施の形態1と同様であり、図2に示すカプセル型内視鏡10が被検体2内を撮像する際における制御部13の制御動作が実施の形態1とは異なる。
(Embodiment 2)
Next, a second embodiment of the present invention will be described.
The configuration of the capsule endoscope and the capsule endoscope system according to the second embodiment is the same as that of the first embodiment, and the
図10は、実施の形態2において制御部13が実行する制御動作を説明するための図である。また、図11A及び図11Bは、撮像部11が撮像を1回行うごとに出力する画像データのデータレベルを示す模式図である。 FIG. 10 is a diagram for explaining a control operation executed by the control unit 13 in the second embodiment. 11A and 11B are schematic diagrams illustrating data levels of image data output each time the imaging unit 11 performs imaging.
カプセル型内視鏡10の電源部17がオン状態に切り替えられると、制御部13は、撮像部11に対し、撮像間隔T4(T4<T3)で2回撮像するという一連の撮像動作を、周期T3ごとに実行させる。なお、周期T3の具体的な数値は特に限定されないが、一般的なカプセル型内視鏡における1フレームあたりの時間(例えば500ms)に設定すると良い。また、撮像間隔T4の具体的な数値も特に限定されないが、周期T3の例えば1/8~1/15程度(例えば30ms~60ms程度)に設定すると良い。
When the
また、制御部13は、上記撮像動作と同期し、照明部12に対し、互いに異なる2種類の分光特性をそれぞれ有する光を撮像間隔T4で順次発生するという一連の発光動作を、周期T3で実行させる。即ち、周期T3内の1回目の撮像において、制御部13は、駆動電流I1で照明部12を駆動することにより、分光特性C1(図6参照)を有する光で所定の発光期間t3、被検体2内を照明する。また、続く2回目の撮像において、制御部13は、駆動電流I2(I2<I1)で照明部12を駆動することにより、分光特性C2(図7参照)を有する光で所定の発光期間t4、被検体2内を照明する。なお、図10においてはt4=t3としている。
Further, the control unit 13 synchronizes with the imaging operation described above, and performs a series of light emitting operations in which the
これより、撮像部11は、周期T3内の1回目の撮像において、長波長側成分よりも短波長側成分が強い光の被検体2からの反射光を受光する。そのため、この反射光においては、被検体2内における吸収にもかかわらず、ヘモグロビンの吸収波長及びその近傍の短波長側成分の強度も十分に残っている。そのため、撮像部11から出力される画像データにおいては、図11Aに示すように、RデータよりもBデータのデータレベルが相対的に高くなる。
Thus, the imaging unit 11 receives the reflected light from the subject 2 with light having a shorter short wavelength side component than the long wavelength side component in the first imaging within the period T 3 . Therefore, in the reflected light, despite the absorption in the
また、撮像部11は、周期T3内の2回目の撮像において、短波長側成分と長波長側成分の強度が同程度の光の被検体2からの反射光を受光する。この反射光においては、被検体2内における吸収により、短波長側成分の強度が大きく減衰している。そのため、撮像部11から出力される画像データにおいては、図11Bに示すように、Rデータと比較して、Bデータのデータレベルが非常に低くなる。
In addition, in the second imaging within the period T 3 , the imaging unit 11 receives reflected light from the subject 2 with light having the same intensity of the short wavelength side component and the long wavelength side component. In this reflected light, the intensity of the short wavelength side component is greatly attenuated by absorption in the
このようにして取得された画像データは、送信部15から無線送信され、受信装置20を介して画像処理装置30に取り込まれる。なお、送信部15は、撮像を1回行うごとに画像データを送信しても良いし、1つの周期T3における2回分の撮像により取得した画像データをまとめて送信しても良い。
The image data acquired in this way is wirelessly transmitted from the transmission unit 15 and taken into the
画像処理部34は、取り込んだ画像データに対して所定の画像処理を施し、1回目の撮像(分光特性C1)により取得された画像データに基づく画像(以下、青色系白色画像という)と、2回目の撮像(分光特性C2)により取得された画像データに基づく画像(以下、単に白色画像という)とを作成する。なお、この際に、被検体2に照射した光における色温度の変化の影響を低減するため、ホワイトバランス処理等を施しても良い。
The image processing unit 34 performs predetermined image processing on the captured image data, an image based on the image data acquired by the first imaging (spectral characteristic C1) (hereinafter referred to as a blue white image), 2 An image based on the image data acquired by the second imaging (spectral characteristic C2) (hereinafter simply referred to as a white image) is created. At this time, white balance processing or the like may be performed in order to reduce the influence of the change in color temperature in the light irradiated on the
続いて、画像処理部34は、青色系白色画像及び白色画像の各々に対し、画像内の画素の画素値(輝度値)のヒストグラムを作成する。この際、1回目と2回目の撮像条件(各回における光の発光強度、発光時間等)を考慮し、青色系白色画像及び白色画像の輝度値を正規化すると好ましい。そして、画像処理部34は、各ヒストグラムに基づいて、白色画像において飽和している画素の画素値を、青色系白色画像内の対応する画素の画素値に置き換えることにより、合成画像を作成する。 Subsequently, the image processing unit 34 creates a histogram of pixel values (luminance values) of pixels in the image for each of the blue white image and the white image. At this time, it is preferable to normalize the luminance values of the blue white image and the white image in consideration of the first and second imaging conditions (light emission intensity, light emission time, etc. at each time). Then, the image processing unit 34 creates a composite image by replacing the pixel value of the pixel saturated in the white image with the pixel value of the corresponding pixel in the blue white image based on each histogram.
ここで、1つの周期T3における2回の撮像によりそれぞれ取得された青色系白色画像と白色画像とでは撮像間隔T4が短いため、被検体2内のほぼ同一の領域が写っているとみなすことができる。また、短波長側成分が強い光により撮像された青色系白色画像は、白色画像と比較して飽和し難いため、白色画像において飽和している領域であっても、青色系白色画像においては飽和していない可能性が高い。そこで、上述した画像処理を実行することにより、適切に階調拡張がなされ、且つブレのない合成画像を得ることができる。また、青色系白色画像は、被検体2内の表層組織の微細な構造をよく反映しているため、画素値の置き換えを行った画素領域の詳細な情報が得られるという利点もある。
Here, since the imaging interval T 4 is short between the blue-based white image and the white image acquired by two imagings in one cycle T 3, it is considered that almost the same region in the
なお、画素値の置き換えを行う画素領域は、ユーザが、表示装置30aに表示された白色画像を目視して、適宜選択するようにしても良い。
It should be noted that the pixel area where the pixel value is replaced may be appropriately selected by the user visually observing the white image displayed on the
この他、画像処理部34は、分光特性C1を有する光の下で取得されたBデータ、並びに、分光特性C2を有する光の下で取得されたGデータ及びRデータをそれぞれ用いて、分光画像を作成しても良い。この場合、Gデータに基づいて、十分に明るい青色成分の分光画像を得ることができる。或いは、青色系白色画像及び白色画像において対応する画素の画素値を加算(又は重み付け加算)することにより、合成画像を作成しても良い。この場合、Bデータのレベルが従来よりも改善されたカラー画像を得ることができる。 In addition, the image processing unit 34 uses the B data acquired under the light having the spectral characteristic C1 and the G data and the R data acquired under the light having the spectral characteristic C2, respectively. May be created. In this case, a spectral image of a sufficiently bright blue component can be obtained based on the G data. Alternatively, a composite image may be created by adding (or weighting addition) pixel values of corresponding pixels in the blue white image and the white image. In this case, it is possible to obtain a color image in which the level of B data is improved as compared with the conventional art.
なお、上記実施の形態2においては、1つの周期T3あたりに2回の撮像を行う場合を説明したが、1つの周期T3あたりの撮像回数は3回以上であっても良い。この場合、撮像回数に応じて、分光特性(即ち、照明部12の駆動電流)を3種類以上に変化させても良い。 In the second embodiment, the case where the imaging is performed twice per cycle T 3 has been described. However, the number of times of imaging per cycle T 3 may be three or more. In this case, the spectral characteristics (that is, the drive current of the illumination unit 12) may be changed to three or more types according to the number of times of imaging.
(変形例1)
図12は、変形例1におけるカプセル型内視鏡10の制御部13による制御動作を説明するための図である。上記実施の形態2においては、1つの周期T3内に2回の撮像を行う際に、分光特性が互いに異なる2種類の光を発生させたが、2回の撮像を行う際に発生する光の分光特性を同一にし、発光量(=光の強度×発光時間)を変化させても良い。例えば、図12に示すように、1回目と2回目とで駆動電流を一定(例えばI2)にし、1回目の発光期間(即ち露光時間)t3よりも、2回目の発光期間t4を短くする。これにより、2回の撮像の間で、被検体2を照明する光の光量(言い換えると、被検体2からの反射光の光量)が変化する。その結果、1つの周期T3において、階調が互いに異なる2つの画像を得ることができる。これらの画像に対して画素値のヒストグラムを作成し、一方の画像において飽和している画素の画素値を、他方の画像の対応する画素の画素値に置き換えることにより、適切に階調拡張がなされた合成画像を得ることができる。
(Modification 1)
FIG. 12 is a diagram for explaining a control operation by the control unit 13 of the
(変形例2)
上記変形例1において、1つの周期T3内における2回の撮像の間で、被検体2を照明する光の光量を変化させる際、発光期間を一定にして、光の強度を変化させても良い。この場合、照明部12の駆動電流を、発生する光の分光特性が大きく変化しない範囲で変動させると良い。
(Modification 2)
In the first modification, when the amount of light that illuminates the subject 2 is changed between two imaging operations within one period T 3 , the light emission period may be constant and the light intensity may be changed. good. In this case, the drive current of the
以上説明した本発明は、実施の形態1及び2並びに変形例1、2に限定されるものではなく、各実施の形態や変形例に開示されている複数の構成要素を適宜組み合わせることによって、種々の発明を形成できる。例えば、各実施の形態や変形例に示される全構成要素からいくつかの構成要素を除外して形成しても良いし、異なる実施の形態や変形例に示した構成要素を適宜組み合わせて形成しても良い。
The present invention described above is not limited to
1 カプセル型内視鏡システム
2 被検体
3 受信アンテナユニット
3a~3h 受信アンテナ
10 カプセル型内視鏡
11 撮像部
12 照明部
13 制御部
14 メモリ
15 送信部
16 アンテナ
17 電源部
20 受信装置
20a クレードル
21 受信部
22 信号処理部
23 メモリ
24 データ送受信部
25 表示部
26 操作部
27 制御部
28 電源部
30 画像処理装置
30a 表示装置
31 入力部
32 データ送受信部
33 記憶部
34 画像処理部
35 出力部
36 制御部
121 基板
122 キャビティ
123 青色LED
124 蛍光体
125 透明樹脂
DESCRIPTION OF
124
Claims (18)
前記照明手段が発生した照明光により照明された被検体内を撮像して、画像データを取得する撮像手段と、
前記撮像手段の撮像動作と同期して、前記照明手段に流す電流の大きさを変化させることにより、前記照明手段が発生する照明光の分光特性を切り替える制御を行う制御手段と、
を備えることを特徴とするカプセル型内視鏡。 A light emitting element that generates light including a first wavelength component when current flows, and a second wavelength component that is different from the first wavelength component by absorbing light including the first wavelength component An illuminating unit that emits illumination light including the first and second wavelength components;
Imaging means for capturing an image of a subject illuminated by illumination light generated by the illumination means, and acquiring image data;
Control means for performing control for switching the spectral characteristics of the illumination light generated by the illumination means by changing the magnitude of a current passed through the illumination means in synchronization with the imaging operation of the imaging means;
A capsule endoscope comprising:
前記第1の分光特性において、前記第2の波長成分に対する前記第1の波長成分の強度比は1より大きく、
前記第2の分光特性において、前記第2の波長成分に対する前記第1の波長成分の強度比は、前記第1の分光特性における前記強度比より小さいことを特徴とする請求項4に記載のカプセル型内視鏡。 The center wavelength of the first wavelength component is shorter than the center wavelength of the second wavelength component,
In the first spectral characteristic, an intensity ratio of the first wavelength component to the second wavelength component is greater than 1,
The capsule according to claim 4, wherein, in the second spectral characteristic, an intensity ratio of the first wavelength component to the second wavelength component is smaller than the intensity ratio in the first spectral characteristic. Type endoscope.
前記カプセル型内視鏡が取得した画像データを処理する画像処理装置と、
を備えることを特徴とするカプセル型内視鏡システム。 A capsule endoscope according to any one of claims 1 to 7,
An image processing device for processing image data acquired by the capsule endoscope;
A capsule endoscope system comprising:
前記画像処理装置は、前記画像データに基づき、前記各色成分の分光画像を作成することを特徴とする請求項8に記載のカプセル型内視鏡システム。 The imaging means acquires image data of each color component of red, green, and blue,
9. The capsule endoscope system according to claim 8, wherein the image processing apparatus creates a spectral image of each color component based on the image data.
前記照明手段が発生した照明光により照明された被検体内を撮像して、画像データを取得する撮像手段と、
前記撮像手段の撮像動作と同期して、前記照明手段に流す電流の大きさを変化させることにより、前記照明手段が発生する照明光の分光特性を切り替える制御を行う制御手段と、
を備え、
前記制御手段は、前記撮像手段に対し、所定の撮像間隔で、分光特性が互いに異なる複数種類の照明光の下で複数回の撮像をそれぞれ行う一連の撮像動作を、所定の周期で繰り返し実行させることを特徴とするカプセル型内視鏡。 A light emitting element that generates light including a first wavelength component when current flows, and a second wavelength component that is different from the first wavelength component by absorbing light including the first wavelength component An illuminating unit that emits illumination light including the first and second wavelength components;
Imaging means for capturing an image of a subject illuminated by illumination light generated by the illumination means, and acquiring image data;
Control means for performing control for switching the spectral characteristics of the illumination light generated by the illumination means by changing the magnitude of a current passed through the illumination means in synchronization with the imaging operation of the imaging means;
With
The control unit causes the imaging unit to repeatedly execute a series of imaging operations for performing imaging a plurality of times under a plurality of types of illumination light having different spectral characteristics at a predetermined imaging interval at a predetermined cycle. A capsule endoscope characterized by that.
前記制御手段は、前記撮像手段に対し、前記第2の波長成分に対する前記第1の波長成分の強度比が1より大きい第1の分光特性を有する照明光の下での第1回目の撮像と、前記第2の波長成分に対する前記第1の波長成分の強度比が前記第1の分光特性における前記強度比より小さい第2の分光特性を有する照明光の下での第2回目の撮像とを、前記撮像間隔で実行させることを特徴とする請求項11に記載のカプセル型内視鏡。 The center wavelength of the first wavelength component is shorter than the center wavelength of the second wavelength component,
The control unit is configured to perform first imaging under illumination light having a first spectral characteristic in which an intensity ratio of the first wavelength component to the second wavelength component is greater than 1 with respect to the imaging unit. A second imaging under illumination light having a second spectral characteristic in which the intensity ratio of the first wavelength component to the second wavelength component is smaller than the intensity ratio in the first spectral characteristic. The capsule endoscope according to claim 11, wherein the capsule endoscope is executed at the imaging interval.
前記カプセル型内視鏡が取得した画像データを処理する画像処理装置と、
を備えることを特徴とするカプセル型内視鏡システム。 The capsule endoscope according to any one of claims 10 to 14,
An image processing device for processing image data acquired by the capsule endoscope;
A capsule endoscope system comprising:
前記画像処理装置は、前記複数回の撮像によりそれぞれ取得された画像データに基づき、前記各色成分の分光画像を作成することを特徴とする請求項15に記載のカプセル型内視鏡システム。
The imaging means acquires image data of each color component of red, green, and blue,
16. The capsule endoscope system according to claim 15, wherein the image processing device creates a spectral image of each color component based on image data acquired by the plurality of times of imaging.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015516328A JPWO2015072432A1 (en) | 2013-11-14 | 2014-11-10 | Capsule endoscope and capsule endoscope system |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013236196 | 2013-11-14 | ||
| JP2013236197 | 2013-11-14 | ||
| JP2013-236196 | 2013-11-14 | ||
| JP2013-236197 | 2013-11-14 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015072432A1 true WO2015072432A1 (en) | 2015-05-21 |
Family
ID=53057366
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2014/079757 Ceased WO2015072432A1 (en) | 2013-11-14 | 2014-11-10 | Capsule endoscope and capsule endoscope system |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JPWO2015072432A1 (en) |
| WO (1) | WO2015072432A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017059246A1 (en) * | 2015-09-30 | 2017-04-06 | The General Hospital Corporation | Systems and methods for an actively controlled optical imaging device |
| WO2019122338A1 (en) * | 2017-12-22 | 2019-06-27 | Syddansk Universitet | Dual-mode endoscopic capsule with image processing capabilities |
| US11147503B2 (en) | 2015-09-30 | 2021-10-19 | The General Hospital Corporation | Systems and methods for an actively controlled optical imaging device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007319442A (en) * | 2006-06-01 | 2007-12-13 | Fujifilm Corp | Capsule endoscope system and image processing apparatus |
| JP2009056248A (en) * | 2007-09-03 | 2009-03-19 | Fujifilm Corp | Light source device, drive control method for light source device, and endoscope |
| WO2010055938A1 (en) * | 2008-11-17 | 2010-05-20 | オリンパス株式会社 | Image-processing system, and imaging device, reception device, and image display device thereof |
| JP2012143397A (en) * | 2011-01-12 | 2012-08-02 | Fujifilm Corp | Endoscope system and light source apparatus for endoscope system |
| JP2012217485A (en) * | 2011-04-04 | 2012-11-12 | Fujifilm Corp | Endoscope system and driving method thereof |
| JP2013146484A (en) * | 2012-01-23 | 2013-08-01 | Fujifilm Corp | Electronic endoscope system, image processing apparatus, image processing method, and image processing program |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002095634A (en) * | 2000-09-26 | 2002-04-02 | Fuji Photo Film Co Ltd | Endoscope system |
| JP4426225B2 (en) * | 2003-07-02 | 2010-03-03 | Hoya株式会社 | Fluorescence observation endoscope system and light source device for fluorescence observation endoscope |
| JP4253550B2 (en) * | 2003-09-01 | 2009-04-15 | オリンパス株式会社 | Capsule endoscope |
| JP5526482B2 (en) * | 2008-02-18 | 2014-06-18 | 日亜化学工業株式会社 | Driving method of light emitting device and light emitting device |
| JP5111286B2 (en) * | 2008-08-08 | 2013-01-09 | シャープ株式会社 | LED lamp driving method and LED lamp device |
| JP5545612B2 (en) * | 2009-01-14 | 2014-07-09 | 富士フイルム株式会社 | Image processing system, image processing method, and program |
| JP2010172673A (en) * | 2009-02-02 | 2010-08-12 | Fujifilm Corp | Endoscope system, processor for endoscope, and endoscopy aiding method |
| JP5289120B2 (en) * | 2009-03-18 | 2013-09-11 | 富士フイルム株式会社 | Endoscope system and processor device for endoscope |
| JP2011067269A (en) * | 2009-09-24 | 2011-04-07 | Fujifilm Corp | Endoscope apparatus |
| JP5371702B2 (en) * | 2009-11-06 | 2013-12-18 | 富士フイルム株式会社 | Electronic endoscope system, processor device for electronic endoscope, and method for operating electronic endoscope system |
| JP5763893B2 (en) * | 2010-06-08 | 2015-08-12 | 富士フイルム株式会社 | Image processing system and program, and operation method of endoscope system |
| JP2012223376A (en) * | 2011-04-20 | 2012-11-15 | Hoya Corp | Control circuit and control method of light-emitting diode for lighting, and electronic endoscope apparatus using the same |
-
2014
- 2014-11-10 WO PCT/JP2014/079757 patent/WO2015072432A1/en not_active Ceased
- 2014-11-10 JP JP2015516328A patent/JPWO2015072432A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007319442A (en) * | 2006-06-01 | 2007-12-13 | Fujifilm Corp | Capsule endoscope system and image processing apparatus |
| JP2009056248A (en) * | 2007-09-03 | 2009-03-19 | Fujifilm Corp | Light source device, drive control method for light source device, and endoscope |
| WO2010055938A1 (en) * | 2008-11-17 | 2010-05-20 | オリンパス株式会社 | Image-processing system, and imaging device, reception device, and image display device thereof |
| JP2012143397A (en) * | 2011-01-12 | 2012-08-02 | Fujifilm Corp | Endoscope system and light source apparatus for endoscope system |
| JP2012217485A (en) * | 2011-04-04 | 2012-11-12 | Fujifilm Corp | Endoscope system and driving method thereof |
| JP2013146484A (en) * | 2012-01-23 | 2013-08-01 | Fujifilm Corp | Electronic endoscope system, image processing apparatus, image processing method, and image processing program |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017059246A1 (en) * | 2015-09-30 | 2017-04-06 | The General Hospital Corporation | Systems and methods for an actively controlled optical imaging device |
| US11147503B2 (en) | 2015-09-30 | 2021-10-19 | The General Hospital Corporation | Systems and methods for an actively controlled optical imaging device |
| WO2019122338A1 (en) * | 2017-12-22 | 2019-06-27 | Syddansk Universitet | Dual-mode endoscopic capsule with image processing capabilities |
| US11457799B2 (en) | 2017-12-22 | 2022-10-04 | Syddansk Universitet | Dual-mode endoscopic capsule with image processing capabilities |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2015072432A1 (en) | 2017-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5259882B2 (en) | Imaging device | |
| US8540626B2 (en) | Endoscope beam source apparatus and endoscope system | |
| JP3869324B2 (en) | Image processing device for fluorescence observation | |
| JP5968944B2 (en) | Endoscope system, processor device, light source device, operation method of endoscope system, operation method of processor device, operation method of light source device | |
| CN107405056B (en) | In vivo observation system | |
| JP6685378B2 (en) | Endoscope light source device and endoscope system | |
| JP2012029703A (en) | Method for controlling endoscope apparatus, and endoscope apparatus | |
| KR100939400B1 (en) | Biological observation device | |
| CN108463157B (en) | endoscope processor | |
| JP6690003B2 (en) | Endoscope system and operating method thereof | |
| JP7130038B2 (en) | Endoscope image processing device, operation method of endoscope image processing device, endoscope image processing program, and storage medium | |
| JPWO2017022324A1 (en) | Endoscopy system signal processing method and endoscope system | |
| WO2015072432A1 (en) | Capsule endoscope and capsule endoscope system | |
| CN111093459A (en) | Endoscope device, image processing method, and program | |
| JP5677555B2 (en) | Endoscope device | |
| US12453466B2 (en) | Endoscope system and operation method therefor | |
| JP7069290B2 (en) | Endoscope system and how to operate it | |
| JP6695416B2 (en) | Endoscope light source device and endoscope system | |
| JP2016067373A (en) | Light source device for endoscope and endoscope system | |
| JP6230511B2 (en) | Endoscope device | |
| JP6095531B2 (en) | Imaging system | |
| US20260026680A1 (en) | Endoscope system and operation method therefor | |
| US20250352071A1 (en) | Medical device, endoscope system, control method, and computer-readable recording medium | |
| WO2016203983A1 (en) | Endoscopic device | |
| WO2017022323A1 (en) | Image signal processing method, image signal processing device and image signal processing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| ENP | Entry into the national phase |
Ref document number: 2015516328 Country of ref document: JP Kind code of ref document: A |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14862093 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14862093 Country of ref document: EP Kind code of ref document: A1 |