JP2010068860A - Endoscope apparatus and image processing method for the same - Google Patents

Abstract

It is possible to easily visually recognize a lesion area of a region of interest on an endoscopic image.
A video processing & control unit includes a video signal processing unit, a index image generation unit as a lesion region information generation unit, an image synthesis unit as a lesion region information superimposing unit, a main illumination dimming unit, A sub-illumination dimming unit 345 and a control unit 343 that controls each of the above-described units are configured to illuminate the region of interest with sub-illumination light having an optical axis angle different from the optical axis angle of the main illumination light. A special captured image having a shadow portion caused by the region is obtained. An index image obtained by reducing the special captured image is superimposed and displayed on the normal captured image.
[Selection] Figure 4

Description

  The present invention relates to an endoscope apparatus that captures an image of a body cavity and an image processing method thereof, and more particularly to an endoscope apparatus that enables a lesion to be visually recognized and an image processing method thereof.

  Conventionally, in the medical field, diagnosis using in-vivo images such as CT images, MRI images, and ultrasound images has been performed, and there are various methods for detecting lesions from in-vivo images by image processing for diagnosis support. It has been proposed (for example, Patent Document 1).

In this type of method, lesion detection detects a region of interest that can become a lesion on an image in a body cavity by image processing. For example, by detecting the amount of change between the pixel of the region of interest and its surrounding pixels, the edge of the region of interest ( For example, a lesion area is estimated from the shape of an edge (shadow) or the like, and it is determined whether or not the region of interest is a lesion.
JP 2008-93172 A

  However, when the conventional lesion detection method described above is applied to an endoscopic image, it is difficult to detect a region of interest that can be a lesion in the first place by image processing if the color / density change on the surface of the living tissue is poor. There's a problem. Furthermore, even if a region of interest that can become a lesion can be detected, if the resolution of the endoscopic image is low, the detection accuracy of the edge (shadow) of the region of interest can be improved by simply performing image processing on the normal endoscopic image. There is a possibility that the lesion area of the region of interest cannot be estimated.

  The present invention has been made in view of such circumstances, and provides an endoscope apparatus and an image processing method thereof that can easily visually recognize a lesion area of a region of interest on an endoscopic image. Objective.

  In order to achieve the object, an endoscope apparatus according to claim 1, an endoscope that irradiates a region of interest in a body cavity with illumination light and images the region of interest, and the interest from the endoscope. An endoscope apparatus comprising: a signal processing device that processes an imaging signal of a part to generate image data; and the illumination light is substantially point-symmetric with respect to the entire field of the imaging field with respect to the center of the field of view. A first illuminating light irradiating means for irradiating the first illuminating light, and a circle substantially centered on the first illuminating light irradiating means on a plane substantially perpendicular to the optical axis of the first illuminating light. A second illuminating light irradiating means for irradiating the second illuminating light of the illuminating light, and the region of interest irradiated with the first illuminating light and / or the second illuminating light. And imaging means for imaging the region of interest based on the first illumination light. Mode setting means for setting a normal imaging mode and a special imaging mode for imaging the region of interest based on the second illumination light, and the first illumination light according to the normal imaging mode or the special imaging mode. Light emission control means for controlling the light emission state of the irradiation means and the second illumination light irradiation means, and a focus area for generating focus area information of the region of interest based on special captured image data captured in the special imaging mode The information generation means is configured to include lesion area information superimposing means for superimposing the lesion area information on normal captured image data captured in the normal imaging mode.

  In the endoscope apparatus according to claim 1, the light emission states of the first illumination light irradiation unit and the second illumination light irradiation unit are controlled according to the normal imaging mode or the special imaging mode, and the Generating lesion region information of the region of interest based on special captured image data captured in the special imaging mode, and superimposing the lesion region information on the normal captured image data captured in the normal imaging mode. This makes it possible to easily visually recognize the lesion area of the region of interest on the endoscopic image.

  Further, as in the endoscope apparatus according to claim 2, the endoscope apparatus according to claim 1, wherein the light emission control unit emits the first illumination light in the normal imaging mode. At the same time, the emission of the second illumination light is stopped or the emission light amount of the second illumination light is reduced to a predetermined light amount or less, and the second illumination light is emitted in the special imaging mode, and the second illumination light is emitted. The light emission of the first illumination light can be stopped or the light emission amount of the first illumination light can be reduced to a predetermined light amount or less.

  Furthermore, like the endoscope apparatus according to claim 3, the endoscope apparatus according to claim 1 or 2, wherein a plurality of the second illumination light irradiation means are provided from different positions on the circumference. The second illumination light is sequentially irradiated one by one, and the light emission control means controls the light emission state for each of the plurality of second illumination lights.

  In the endoscope apparatus according to any one of claims 1 to 3, the lesion region information is preferably reduced image information of the special captured image data.

  Moreover, like the endoscope apparatus of Claim 5, It is an endoscope apparatus of Claim 1 or 2, Comprising: The said lesion area | region information generation means is the said normal captured image data and the said special captured image data. And extracting the shadow part of the region of interest, and generating the lesion region information based on the shadow part.

  Further, as in the endoscope apparatus according to claim 6, the endoscope apparatus according to claim 3, wherein the lesion region information generation unit includes the normal captured image data and the plurality of second illuminations. It is possible to compare each of the plurality of special captured image data with light, extract a shadow portion of the region of interest, and generate the lesion region information based on the shadow portion.

  Furthermore, as in the endoscope apparatus according to claim 7, the endoscope apparatus according to claim 6, wherein the lesion area information generation unit further includes the plurality of special captured image data. It is possible to compare the data between at least two special captured image data, extract a shadow portion of the region of interest, and generate the lesion region information based on the shadow portion.

  In the endoscope apparatus according to any one of claims 5 to 7, the lesion region information includes the region information of the shadow portion or the region information of the uneven portion of the region of interest forming the shadow portion. A mark image or a character image is preferably shown.

  The image processing method of the endoscope apparatus according to claim 11, wherein an endoscope that irradiates a region of interest in a body cavity with illumination light to image the region of interest, and an imaging signal of the region of interest from the endoscope An image processing method of an endoscope apparatus including a signal processing device that generates image data by performing signal processing on the first of the illumination lights with respect to the entire field of view of the imaging substantially symmetrical with respect to the center of the field of view. A first illuminating light irradiation step for irradiating the illuminating light, and a circle around the first illuminating light irradiating means on the surface substantially perpendicular to the optical axis of the first illuminating light. A second illumination light irradiation step of irradiating the second illumination light of the illumination light, and an imaging step of imaging the region of interest irradiated with the first illumination light and / or the second illumination light. And a normal imaging mode for imaging the region of interest based on the first illumination light. And a mode setting step for setting a special imaging mode for imaging the region of interest based on the second illumination light, and the first illumination light and the second according to the normal imaging mode or the special imaging mode. An irradiation control step for controlling the irradiation state of the illumination light, a lesion region information generating step for generating lesion region information of the region of interest based on special captured image data captured in the special imaging mode, and the normal imaging A lesion region information superimposing step of superimposing the lesion region information on the normal captured image data captured in the mode.

  The image processing method for an endoscope apparatus according to claim 11, wherein an irradiation state of the first illumination light and the second illumination light is controlled according to the normal imaging mode or the special imaging mode, and the special imaging mode is selected. By generating the lesion region information of the region of interest based on the special captured image data imaged in the imaging mode, and superimposing the lesion region information on the normal captured image data imaged in the normal imaging mode, It is possible to easily visually recognize a lesion area of a region of interest on an endoscopic image.

  Further, as in the image processing method of the endoscope apparatus according to claim 12, the image processing method of the endoscope apparatus according to claim 11, wherein the light emission control step is performed when the normal imaging mode is performed. While emitting the first illumination light, stopping the emission of the second illumination light or reducing the emission light amount of the second illumination light to a predetermined light amount or less, and in the special imaging mode, the second illumination light The light can be emitted and the light emission of the first illumination light can be stopped or the light emission amount of the first illumination light can be reduced to a predetermined light amount or less.

  Furthermore, as in the image processing method for an endoscope apparatus according to claim 13, the image processing method for an endoscope apparatus according to claim 11 or 12, wherein the second illumination light irradiation step includes the step A plurality of the second illumination lights are sequentially irradiated one by one from different positions on the circumference, and the irradiation control step is configured to control a light emission state for each of the plurality of second illumination lights. it can.

  Furthermore, as in the image processing method for an endoscope apparatus according to claim 14, the image processing method for an endoscope apparatus according to claim 11 or 12, wherein the lesion region information generation step includes the normal region information generation step. The captured image data and the special captured image data may be compared to extract a shadow portion of the region of interest, and the lesion region information may be generated based on the shadow portion.

  Moreover, it is the image processing method of the endoscope apparatus according to claim 13, as in the image processing method of the endoscope apparatus according to claim 15, wherein the lesion region information generation step includes the normal captured image data. Is compared with each of the plurality of special captured image data by the plurality of second illumination lights, and a shadow part of the region of interest is extracted, and the lesion region information is generated based on the shadow part. be able to.

  Furthermore, as in the image processing method for an endoscope apparatus according to claim 16, the image processing method for an endoscope apparatus according to claim 15, further comprising the step of generating the lesion region information. Comparing at least two pieces of special captured image data among the special captured image data, extracting a shadow portion of the region of interest, and generating the lesion region information based on the shadow portion Can do.

  As described above, according to the present invention, there is an effect that the lesion area of the region of interest can be easily visually recognized on the endoscopic image.

  Hereinafter, a preferred embodiment of an endoscope apparatus according to the present invention will be described in detail with reference to the accompanying drawings.

First embodiment:
FIG. 1 is a block diagram showing the configuration of the endoscope apparatus of the present embodiment. As shown in FIG. 1, an endoscope apparatus 1 according to this embodiment includes an electronic endoscope 2 as an endoscope, a video processor 3 as a signal processing apparatus, a light source device 4, and a monitor 5. .

  The electronic endoscope 2 includes, for example, a CCD 23 as an imaging unit, which is a solid-state imaging device, in the distal end of an insertion portion 21 that is inserted into a lumen. In the electronic endoscope 2, a light guide 22 as a first illumination light irradiating means for transmitting illumination light as first illumination light from the light source device 4 is disposed inside the insertion portion 21. ing. A plurality of, for example, four white LEDs 24a, 24b, 24c, and 24d as second illumination light irradiation means that emit white light as second illumination light are provided on the outer periphery of the distal end of the insertion portion 21. (In FIG. 1, the white LEDs 24b and 24d are omitted).

  In the present embodiment, four white LEDs are described as an example of the second illumination light irradiating means. However, the present invention is not limited to this, and may be configured by one or more white LEDs, and at least the first illumination light. The white LED is arranged so as to irradiate the second illumination light from the circumference of a circle substantially centered on the light guide 22 (first illumination light irradiation means) on the surface substantially perpendicular to the optical axis of I just need it.

  The CCD 23 has a color filter (not shown) on the light receiving surface side, and subjects images irradiated with white illumination light from the light source device 4 and white illumination light from the white LEDs 24a, 24b, 24c, and 24d, for example, RGB In this case, the image signal is captured as a color image or a complementary color image, and an image signal is transmitted to the video processor 3 via an amplifier.

  In the present embodiment, the CCD 23 is provided with a color filter (not shown) to capture a color image. However, the present invention can also be applied to an electronic endoscope that obtains a black and white image without providing a color filter.

  The white LEDs 24a, 24b, 24c, and 24d are covered with balloons 25a, 25b, 25c, and 25d, respectively. The balloons 25a, 25b, 25c, and 25d are configured by a blocking member that blocks light, and a transmission opening (details will be described later) that diffuses and transmits light is provided on the distal end side of the insertion portion 21. The white light generated from the white LEDs 24a, 24b, 24c, and 24d is diffused by passing through the transmission openings of the balloons 25a, 25b, 25c, and 25d, and emits light in a surface light source state.

  The video processor 3 includes a CCD driver 32 that drives the CCD 23, an LED driver 31 that independently drives the white LEDs 24a, 24b, 24c, and 24d, and a balloon control unit 35 that inflates / deflates the balloons 25a, 25b, 25c, and 25d. A video pre-processing unit 33 that performs pre-processing on the image pickup signal from the CCD 23, and video processing and control that generates image data and various control signals based on the video signal pre-processed by the video pre-processing unit 33. And a mode setting unit 36 as mode setting means for setting the imaging mode.

  The video pre-processing unit 33 samples the image pickup signal from the CCD 23 using, for example, a correlated double sampling circuit and performs various pre-processing such as white balance processing, auto gain adjustment, A / D conversion processing, and the like. This is a processing unit that transmits to the processing & control unit 34, and a detailed configuration thereof is publicly known, and a description thereof will be omitted.

  The video processing & control unit 34 performs various types of images on the video signal from the video preprocessing unit 33 such as colorization processing (including synchronization processing), γ correction processing, contour enhancement processing, image enlargement / reduction processing, and the like. The image data is generated by performing processing, and the generated image data is converted into, for example, a standard TV signal and output to the monitor 5 to display the endoscopic image on the monitor. The image processing in the video processing & control unit 34 is well known and will not be described in detail, but the focus area information generation and superposition control configuration of the video processing & control unit 34 which is a characteristic configuration of the present embodiment. Details of this will be described later.

  The mode setting unit 36 includes a normal shooting mode in which shooting is performed with the main illumination light (first illumination light) from the light guide 22 serving as the first illumination light irradiation unit, and a white LED 24a serving as the second illumination light irradiation unit. , 24b, 24c, and 24d, a setting unit that switches and sets a special shooting mode that is shooting using the sub-illumination light (second illumination light), and the mode setting unit 36 includes white LEDs 24a, 24b, 24c, The lighting / extinguishing timing can be set every 24d.

  The light source device 4 includes, for example, a lamp unit 41 configured by a xenon lamp and the like, and a diaphragm 42 that adjusts the amount of white first illumination light emitted from the lamp unit 41 and supplies the light to the incident surface of the light guide 22. And is configured.

  2 and 3 are views for explaining a white LED and a balloon provided at the distal end of the insertion portion of the electronic endoscope of FIG. 1, FIG. 2 shows a side surface of the distal end of the insertion portion, and FIG. The tip surface of the part is shown.

  As shown in FIGS. 2 and 3, the white LEDs 24a, 24b, 24c, and 24d are arranged radially at the distal end side surface of the insertion portion at a 90-degree interval with the longitudinal axis of the insertion portion 21 as the center. The direction is set parallel to the longitudinal axis of the insertion portion 21. Each white LED 24a, 24b, 24c, 24d is covered with balloons 25a, 25b, 25c, 25d. The balloons 25a, 25b, 25c, and 25d are inflated from the contracted state by the balloon control unit 35 when the insertion unit 21 is inserted into the body cavity and the endoscopic examination is started, and the white LEDs 24a, 24b, and 24c. , 24d is diffused by the transmission openings 29a, 29b, 29c, 29d of the balloons 25a, 25b, 25c, 25d.

  An observation window 27 for forming an image on the CCD 23, illumination windows 26 a and 26 b for irradiating the first illumination light from the exit surface of the light guide 22, and a treatment tool are provided on the distal end surface of the insertion portion 21. And the like. As described above, the white LEDs 24a, 24b, 24c covered with the balloons 25a, 25b, 25c, 25d are provided. , 24d are arranged on the distal end side surface of the insertion portion 21.

  FIG. 4 is a block diagram showing a control configuration of the video processing & control unit of the video processor of FIG. The video processing & control unit 34 includes a video signal processing unit 341, an index image generation unit 346 as a lesion region information generation unit, an image composition unit 342 as a lesion region information superimposition unit, a main illumination dimming unit 344, and a sub illumination dimming unit. A unit 345 and a control unit 343 that controls the above-described units are provided. The light emission control means is configured by the control unit 343.

  As described above, the video signal processing unit 341 performs, for example, colorization processing (including synchronization processing), γ correction processing, contour enhancement processing, image enlargement / reduction processing on the processing signal from the video preprocessing unit 33. This is a processing unit that performs a known video signal processing that generates image data by performing various image processing such as, converts the generated image data into, for example, a standard TV signal, and outputs it to the monitor 5.

  The control unit 343 controls each unit in the video processing & control unit 34 based on the mode setting signal from the mode setting unit 36.

  Specifically, when the normal imaging mode is input as a mode setting signal from the mode setting unit 36, for example, the control unit 343 controls the main illumination dimming unit 344 and uses the main dimming signal at the diaphragm 42 of the light source device 4. The amount of main illumination light (first illumination light) is adjusted to a predetermined amount. The control unit 343 causes the light guide 22 to irradiate the region of interest, which is the subject in the body cavity, with a predetermined amount of main illumination light (first illumination light), causes the CCD 23 to image the region of interest, and outputs the video signal. The processing unit 341 performs control so that normal captured image data is acquired. In this normal imaging mode, the control unit 343 controls the sub illumination dimming unit 345 so that the LED driver 31 turns off all the white LEDs 24a, 24b, 24c, and 24d by the sub dimming signal. At this time, the control unit 343 controls the balloon control unit 35 based on the balloon control signal to bring the balloons 25a, 25b, 25c, and 25d into a deflated state.

  In addition, when the special imaging mode is input as a mode setting signal from the mode setting unit 36, the control unit 343 causes the video signal processing unit 341 to capture the previous normal captured image data and controls the main illumination dimming unit 344. Thus, the amount of main illumination light (first illumination light) is reduced at the diaphragm 42 of the light source device 4 by the main dimming signal. In addition, the control unit 343 controls the sub illumination dimming unit 345 so that the LED driver 31 sequentially emits the white LEDs 24a, 24b, 24c, and 24d with a predetermined light amount by the sub dimming signal. At this time, the control unit 343 controls the balloon control unit 35 based on the balloon control signal to place the balloons 25a, 25b, 25c, and 25d in an inflated state. Then, the control unit 343 sequentially irradiates the region of interest which is the subject in the body cavity with the sub-illumination light (second illumination light) having a predetermined amount of light from the white LEDs 24a, 24b, 24c, and 24d. Control is performed so that the image signal processing unit 341 acquires (captures) special captured image data.

  The index image generation unit 346 reduces the special captured image data by the white LEDs 24a, 24b, 24c, and 24d, and generates a plurality of index images.

  In the normal imaging mode, the image composition unit 342 generates a standard TV signal based on the normal captured image data and outputs the standard TV signal to the monitor 5 as an image signal. Further, in the special imaging mode, the image composition unit 342 generates a composite image in which a plurality of index images generated by the index image generation unit 346 are superimposed on the normal captured image data captured by the video signal processing unit 341, and the composite image A standard TV signal is generated based on the data and output to the monitor 5 as an image signal.

  The main illumination dimming unit 344 controls the diaphragm 42 of the light source device 4 based on the control of the control unit 343, and adjusts the amount of main illumination light. Further, the sub illumination dimming unit 345 controls the LED driver 31 based on the control of the control unit 343, and adjusts the emission of the sub illumination light by the white LEDs 24a, 24b, 24c, and 24d.

  The operation of the present embodiment configured as described above will be described based on the flowchart of FIG. FIG. 5 is a flowchart for explaining the operation of the video processing & control unit of FIG.

  When the operator turns on the power of each part of the endoscope apparatus 1, as shown in FIG. 5, the control unit 343 controls the main illumination dimming unit 344 to set the main illumination light amount to a predetermined default value. (Step S1). At this time, the control unit 343 controls the sub illumination dimming unit 345 and the balloon control unit 35 to turn off all the white LEDs 24a, 24b, 24c, and 24d, and puts the balloons 25a, 25b, 25c, and 25d into a contracted state. When the power is turned on, the control unit 343 inputs the normal imaging mode from the mode setting unit 36 as a mode setting signal.

  When the surgeon inserts the insertion unit 21 into the body cavity of the patient, the control unit 343 controls the video signal processing unit 341 to start normal imaging in the body cavity (step S2). At this time, in the body cavity, the region of interest, which is the subject in the body cavity, is illuminated only by the main illumination light. The CCD 23 images the region of interest at a predetermined frame rate, and the video signal processing unit 341 performs time-series normal processing. Captured image data is acquired. Then, the image composition unit 342 converts the time-series normal captured image data acquired by the video signal processing unit 341 into a standard TV signal and displays it on the monitor 5 as a color moving image.

  Next, the control unit 343 determines whether or not the mode setting signal from the mode setting unit 36 has been switched to the special imaging mode (step S3). If the mode setting signal is switched to the special imaging mode, the process proceeds to step S4. If the mode setting signal remains in the normal imaging mode, the process proceeds to step S9.

  When determining that the mode setting signal has been switched to the special imaging mode, the control unit 343 causes the video signal processing unit 341 to capture the previous normal captured image data (step S4).

  Next, the control unit 343 controls the main illumination dimming unit 344 to reduce the main illumination light amount, and controls the balloon control unit 35 to put the balloons 25a, 25b, 25c, and 25d into an inflated state (step S5). ).

  Then, the control unit 343 sequentially causes the white LED 24a, 24b, 24c, and 24d to irradiate the sub-illumination light (second illumination light) of a predetermined amount to the region of interest that is the subject in the body cavity, and causes the video signal processing unit 341 to perform irradiation. Then, special imaging for acquiring (capturing) special captured image data is started (step S6).

  Next, the control unit 343 controls the index image generation unit 346 to reduce each of the special captured image data by sequential light emission of the white LEDs 24a, 24b, 24c, and 24d, and generate a plurality of index images. Then, the control unit 343 controls the image composition unit 342 to superimpose the generated index images on the normal captured image captured in step S4, and displays the combined image on the monitor 5 (step S7). This composite display continues until the mode setting signal is switched to the normal imaging mode (step S8).

  And the control part 343 repeats the process of the said step S3-step S8 until it confirms the test | inspection completion | finish instruction | indication by a surgeon (step S9).

  Here, details of steps S6 and S7 will be described with reference to FIGS. FIG. 6 is a diagram for explaining illumination of a region of interest by the sub illumination light (second illumination light) of the white LED of FIG. As shown in FIG. 6, in the present embodiment, in the normal imaging mode, the region of interest 51 inside the body cavity 50 is imaged with the main illumination light (first illumination light) 52.

  FIG. 7 is a diagram showing a normal captured image by the main illumination light (first illumination light) of the light guide of FIG. 1, and in the normal imaging mode, a normal captured image having a region-of-interest image 51 a obtained by capturing the region of interest 51. 52a is displayed on the monitor 5. In step S4, the normal captured image 52a immediately before switching to the special imaging mode is captured by the video signal processing unit 341.

  On the other hand, in the special imaging mode, as shown in FIG. 6, the sub illumination light (second illumination light) 53 from the white LD arranged at a position different from the irradiation position of the main illumination light (first illumination light) 52. Thus, the region of interest 51 is imaged (step S6). In this case, the sub illumination light (second illumination light) 53 is emitted from the transmission openings 29a, 29b, 29c, and 29d (see FIGS. 2 and 3) of the balloons 25a, 25b, 25c, and 25d. The irradiation optical axis angle of the light (first illumination light) 52 and the irradiation optical axis angle of the sub illumination light (second illumination light) 53 are different, and the main illumination is performed in the irradiation of the sub illumination light (second illumination light) 53. A shadow portion 54 different from the irradiation of the illumination light (first illumination light) 52 is generated. FIG. 8 is a diagram showing a special captured image by the sub-illumination light (second illumination light) of the white LED of FIG. 1, and in the special imaging mode, a special captured image of the region-of-interest image 51a having the shadow portion image 54a. 53a is displayed on the monitor 5.

  The shadow portion 54 is formed by reflecting the uneven shape of the region of interest 51, and the uneven shape of the region of interest 51 is caused by the lesion region of the region of interest 51. The index image obtained by reducing the specially-captured image having the shaded portion 54 associated with is used as lesion area information.

  FIG. 9 is a diagram showing a composite image obtained by superimposing a plurality of index images on the normal captured image by the image composition unit of FIG. Each of the image data is reduced to generate a plurality of index images 60a, 60b, 60c, 60d. Then, the image composition unit 342 displays the index image 60a, 60b, 60c, 60d on the monitor 5 by superimposing it on the lower part of the normal captured image 52a obtained by capturing the plurality of index images 60a, 60b, 60c, 60d (step S7).

  As described above, in the present embodiment, the region of interest 51 is illuminated with the sub-illumination light having an optical axis angle different from the optical axis angle of the main illumination light, and the special region having the shadow portion 54 caused by the lesion area is captured. A captured image 53a can be obtained. The index image 60a, 60b, 60c, 60d obtained by reducing the special captured image 53a is superimposed and displayed on the normal captured image 52a, so that the lesion region of the region of interest 51 can be easily displayed on the endoscopic image. Allows visual recognition.

  In the above description, the balloon inflated state is described as being constant. However, the present invention is not limited to this. For example, in the special imaging mode, the control unit 343 may inflate the balloon in multiple stages. FIG. 10 is a diagram showing the stepwise expansion of the balloon of FIG. 1, and the sub-illumination light (first illumination light) 52 with respect to the irradiation optical axis of the main illumination light (first illumination light) 52 by expanding the balloon in multiple stages. The irradiation optical axis of the (second illumination light) 53 can be tilted in multiple stages, and the shadow portion 54 reflecting the uneven shape can be imaged.

  That is, FIG. 11 is a diagram showing a special image obtained by multi-stage inflation of the balloon of FIG. 10, and the shadow portion image of the region-of-interest image 51a is in an inflated state when the balloon 25a is in the first stage (dotted line in FIG. 10). In FIG. 11, the shadow portion image 54a (dotted line in FIG. 11) is obtained, but the balloon 25a becomes the shadow portion image 54A (solid line in FIG. 11) in the second stage inflated state (solid line in FIG. 10). Since this shadow part image 54A reflects the uneven shape of the region of interest 51 more than the shadow part image 54a, it becomes possible to visually recognize the lesion area more easily.

Second embodiment:
This embodiment has the same configuration as that of the first embodiment, and only the configuration of the video processing & control unit 34 is different. Therefore, only different points will be described.

  FIG. 12 is a block diagram showing a configuration of a video processing & control unit according to the second embodiment. In the present embodiment, as shown in FIG. 12, the video processing & control unit 34 is configured to include a special captured image analysis unit 347 as lesion area information generation means instead of the index image generation unit 346.

  The special captured image analysis unit 347 compares the special captured image and the normal captured image by image processing, extracts a shadow or uneven shape, estimates a lesion area based on the extracted shadow or uneven shape, Focal region information including marker graphics or character graphics for enabling the estimated focal region to be visually recognized is generated and output to the image composition unit 342. Other configurations are the same as those of the first embodiment.

  The operation of the present embodiment configured as described above will be described with reference to the flowchart of FIG. FIG. 13 is a flowchart for explaining the operation of the video processing & control unit of FIG.

  The operation of the present embodiment configured as described above is almost the same as that of the first embodiment as shown in FIG. 13, and the process of step S7a is executed instead of the process of step S7. That is, in the present embodiment, after the processing of steps S1 to S6, in step S7a, the special captured image and the normal captured image are compared by image processing, or between the special captured images by sub illumination light at different positions. For example, using the fact that there is a high possibility that an area with a large luminance difference is a shadow due to the three-dimensional structure of the subject, the shadow or uneven shape is extracted, and the extracted shadow or uneven shape is extracted. Based on this, a lesion area is estimated, and lesion area information including a marker graphic or a character graphic for enabling the estimated lesion area to be visually recognized is generated and output to the image composition unit 342.

  For example, the images to be compared (between the special captured image and the normal captured image, as can be seen from the difference in the position where the shadow is formed, when the observation object is raised in a dome shape and when it is depressed in a crater shape. Automatic determination of whether the shape of the observation object is convex or concave by taking into account the positional relationship of the illumination light (between special captured images) and the difference between the two images in the shaded area (luminance relationship) You can also

  In addition, when comparing between specially picked-up images, a combination in which the angle of the illumination optical axis further expands is desirable in order to make the shadow portion more prominent. For example, in the case of the structure shown in FIG. 3, it is desirable to compare between the image by the transmissive opening 29a and the image by the transmissive opening 29c, or between the image by the transmissive opening 29b and the image by the transmissive opening 29d.

  Thereafter, the process proceeds to step S8. Other operations are the same as those in the first embodiment.

  By executing the processing in step S7a, a special captured image 53a as shown in FIG. 14 or FIG. 15 is displayed on the monitor as a composite image. FIG. 14 is a diagram showing an example of highlighting (for example, colored display or blinking display) of a shadow portion image 541 reflecting a lesion area in the region-of-interest image 51a, and FIG. 15 is caused by the estimated lesion area image. FIG. 6 is a diagram in which a pattern graphic 542 having an uneven shape is superimposed on a region-of-interest image 51a and a character image 543 showing the uneven shape is superimposed and displayed.

  In the present embodiment, it is possible to display an emphasis display of these shaded portions, an uneven pattern schematic figure, or a character figure in any combination.

  Thus, also in the present embodiment, the focus area of the region of interest 51 can be easily displayed on the endoscopic image by highlighting the shaded portion, the concavo-convex pattern or character graphic, as in the first embodiment. It can be visually recognized.

  Although the endoscope apparatus of the present invention has been described in detail above, the present invention is not limited to the above examples, and various improvements and modifications may be made without departing from the scope of the present invention. Of course.

The block diagram which shows the structure of the endoscope apparatus which concerns on 1st Embodiment. The figure which shows the side surface of the front-end | tip of an insertion part for demonstrating white LED and the balloon provided in the front-end | tip of the insertion part of the electronic endoscope of FIG. The figure which shows the front end surface of the insertion part for demonstrating white LED and the balloon provided in the front-end | tip of the insertion part of the electronic endoscope of FIG. The block diagram which shows the structure of the video processing & control part of the video processor of FIG. Flowchart for explaining the operation of the video processing & control unit of FIG. The figure explaining the illumination of the site | part of interest by the sub illumination light (2nd illumination light) of white LED of FIG. The figure which shows the normal captured image by the main illumination light (1st illumination light) of the light guide of FIG. The figure which shows the special picked-up image by the sub illumination light (2nd illumination light) of white LED of FIG. FIG. 1 is a diagram illustrating a composite image in which a plurality of index images are superimposed on a normal captured image by the image composition unit in FIG. 1. FIG. 1 is a diagram showing stepwise inflation of the balloon of FIG. The figure which shows the special picked-up image by multistage expansion of the balloon of FIG. The block diagram which shows the structure of the video processing & control part which concerns on 1st Embodiment. Flowchart for explaining the operation of the video processing & control unit of FIG. The figure which shows the example which highlighted (for example, coloring display or blinking display) the shadow part image which reflected the lesion area | region in the region-of-interest image by the image | video process & control part of FIG. The figure which superimposed and displayed the character image which shows the uneven | corrugated shape on the region-of-interest image on which the schematic figure of the uneven | corrugated shape resulting from the lesion area image estimated by the image | video process & control part of FIG. 12 was superimposed.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Endoscope apparatus, 2 ... Electronic endoscope (endoscope), 3 ... Video processor (signal processing apparatus), 4 ... Light source device, 5 ... Monitor, 21 ... Insertion part, 22 ... Light guide (1st Illumination light irradiation means), 23... CCD (imaging means), 24a, 24b, 24c, 24d... White LED (second illumination light irradiation means), 25a, 25b, 25c, 25d. 32 ... CCD driver, 33 ... Video pre-processing unit, 34 ... Video processing & control unit, 35 ... Balloon control unit (balloon control unit), 36 ... Mode setting unit (mode setting unit), 41 ... Lamp unit, 42 ... Aperture 341: Video signal processing unit 342 Image compositing unit (focal area information superimposing unit) 343 Control unit (light emission control unit) 344 Main illumination dimming unit 345 Sub illumination dimming unit 346 Index Image generating unit (lesion area information generating means), 347 ... special captured image analysis unit (lesion area information generation means)

Claims (16)

An endoscope that irradiates a region of interest within a body cavity with illumination light and images the region of interest, and a signal processing device that generates image data by performing signal processing on an imaging signal of the region of interest from the endoscope. In an endoscope apparatus,
The endoscope is
A first illumination light irradiating means for irradiating the first illumination light of the illumination light substantially point-symmetrically with respect to the entire field of the imaging field, and substantially perpendicular to the optical axis of the first illumination light; A second illuminating light irradiating means for irradiating a second illuminating light of the illuminating light from a circumference of a circle substantially centered on the first illuminating light irradiating means on a smooth surface; Imaging means for imaging the region of interest irradiated with illumination light and / or the second illumination light,
The signal processing device includes:
Mode setting means for setting a normal imaging mode for imaging the site of interest based on the first illumination light and a special imaging mode for imaging the site of interest based on the second illumination light; and the normal imaging mode Or a light emission control means for controlling the light emission state of the first illumination light irradiation means and the second illumination light irradiation means in accordance with the special imaging mode, and special captured image data captured in the special imaging mode. A lesion area information generating means for generating the lesion area information of the region of interest based on the lesion area information superimposing means for superimposing the lesion area information on the normal captured image data imaged in the normal imaging mode. An endoscope apparatus characterized by the above. The light emission control means includes
During the normal imaging mode, the first illumination light is emitted and the second illumination light is stopped or the light emission amount of the second illumination light is reduced to a predetermined light amount or less.
In the special imaging mode, the second illumination light is emitted, the light emission of the first illumination light is stopped, or the light emission amount of the first illumination light is reduced to a predetermined light amount or less. The endoscope apparatus according to claim 1. The second illumination light irradiation means sequentially emits the plurality of second illumination lights one by one from different positions on the circumference, and the light emission control means emits light for each of the plurality of second illumination lights. The endoscope apparatus according to claim 1, wherein the state is controlled. The endoscope apparatus according to any one of claims 1 to 3, wherein the lesion region information is reduced image information of the special captured image data. The lesion region information generation means compares the normal captured image data with the special captured image data, extracts a shadow portion of the region of interest, and generates the lesion region information based on the shadow portion. The endoscope apparatus according to claim 1 or 2. The lesion region information generation unit compares the normal captured image data with each of the plurality of special captured image data by the plurality of second illumination lights, extracts a shadow portion of the region of interest, and the shadow portion The endoscopic device according to claim 3, wherein the lesion area information is generated based on the information. The lesion area information generation means further compares data between at least two special captured image data of the plurality of special captured image data, extracts a shadow portion of the region of interest, and based on the shadow portion The endoscope apparatus according to claim 6, wherein the lesion area information is generated. 8. The lesion area information is a mark image or a character image indicating area information of the shaded part or area information of the uneven part of the region of interest forming the shaded part. The endoscope apparatus according to one. A balloon covering the second illumination light irradiation means; and a balloon control means for inflating and deflating the balloon;
The said balloon is comprised by the light-shielding member which interrupts | blocks the said 2nd illumination light, and has the permeation | transmission opening part which diffusely permeate | transmits the said 2nd illumination light in the said imaging visual field side of the said light-shielding member. The endoscope apparatus according to any one of 1 to 8. The balloon control means inflates the balloon in multiple stages,
The light emission control means controls the light emission state of the second illumination light irradiation means according to the special imaging mode for each of the multistage inflation states of the balloon,
The endoscope apparatus according to claim 9, wherein the lesion area information generation unit generates the lesion area information for each of the multistage inflation states of the balloon. An endoscope that irradiates a region of interest within a body cavity with illumination light and images the region of interest, and a signal processing device that generates image data by performing signal processing on an imaging signal of the region of interest from the endoscope. In the image processing method of the endoscope apparatus,
A first illuminating light irradiation step of irradiating the first illuminating light of the illuminating light in a substantially point symmetrical manner with respect to the entire field of the imaging field;
Irradiating the second illumination light of the illumination light from the circumference of a circle substantially centered on the first illumination light irradiating means on the surface substantially perpendicular to the optical axis of the first illumination light. Two illumination light irradiation steps;
An imaging step of imaging the region of interest irradiated with the first illumination light and / or the second illumination light;
A mode setting step for setting a normal imaging mode for imaging the site of interest based on the first illumination light and a special imaging mode for imaging the site of interest based on the second illumination light;
An irradiation control step of controlling an irradiation state of the first illumination light and the second illumination light according to the normal imaging mode or the special imaging mode;
Focal region information generation step for generating focal region information of the region of interest based on special captured image data captured in the special imaging mode;
An image processing method for an endoscope apparatus, comprising: a lesion region information superimposing step of superimposing the lesion region information on normal captured image data captured in the normal imaging mode. The light emission control step includes:
During the normal imaging mode, the first illumination light is emitted and the second illumination light is stopped or the light emission amount of the second illumination light is reduced to a predetermined light amount or less.
In the special imaging mode, the second illumination light is emitted, the light emission of the first illumination light is stopped, or the light emission amount of the first illumination light is reduced to a predetermined light amount or less. The image processing method of the endoscope apparatus according to claim 11. The second illumination light irradiation step sequentially irradiates the plurality of second illumination lights one by one from different positions on the circumference, and the irradiation control step emits light for each of the plurality of second illumination lights. The state is controlled. The image processing method of an endoscope apparatus according to claim 11 or 12. The lesion region information generation step compares the normal captured image data with the special captured image data, extracts a shadow portion of the region of interest, and generates the lesion region information based on the shadow portion. An image processing method for an endoscope apparatus according to claim 11 or 12. The lesion region information generation step compares the normal captured image data with each of the plurality of special captured image data by the plurality of second illumination lights, extracts a shadow portion of the region of interest, and the shadow portion The image processing method of the endoscope apparatus according to claim 13, wherein the lesion area information is generated based on the information. The lesion region information generation step further compares data between at least two special captured image data of the plurality of special captured image data, extracts a shadow portion of the region of interest, and based on the shadow portion The image processing method of the endoscope apparatus according to claim 15, wherein the lesion area information is generated.

Images