JP2008229208A - Electronic scope of electronic endoscope system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic scope transmitting information to an imaging processor with digital signals. <P>SOLUTION: The electronic scope of the electronic endoscope system has an imaging element. It is equipped with a multiplexer for output of the digital image data acquired by time-sharing and multiplexing the image signal of the effective imaging term of each line acquired by the imaging element, a synchronous word added before and after the digital image data, a synchronous word added after the digital image data, and a digital signal having a digital blanking term generated between the synchronous words added before the digital image data in the next effective imaging term. At least one of information about the characteristic of an electronic scope and about the operation of the electronic scope, and the sound signals inputted in the electronic scope are overlapped during the digital blanking term. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic scope of an electronic endoscope system, and more particularly to an electronic scope that transmits image data and the like to an image processor using a digital signal.

  2. Description of the Related Art Conventionally, there has been proposed an electronic endoscope system that includes an electronic scope that includes an imaging device and transmits image data obtained by imaging to an image processor with a digital signal.

Patent Document 1 discloses an image processor that transmits image data and audio signals to a remote device as parallel digital signals (or serial digital signals). When this is used between an electronic scope and an image processor, it is possible to digitally transmit image data and audio signals.
Japanese Unexamined Patent Publication No. 09-9109

  However, information other than image data and audio signals (information on characteristics of the electronic scope such as characteristics of the imaging device) needs to be transmitted between the electronic scope and the image processor.

  Accordingly, it is an object of the present invention to provide an electronic scope that transmits information as digital signals to an image processor.

  An electronic scope of an electronic endoscope system according to the present invention includes an image sensor, and digital image data obtained by time-division multiplexing image signals of an effective image period for each line of the image sensor obtained by the image sensor. And a synchronization word added before and after the digital image data, and a synchronization word added after the digital image data and a synchronization word added before the digital image data in the next effective video period. The digital blanking period includes a multiplexer that outputs a digital signal having a digital blanking period, and at least one of the information regarding the characteristics of the electronic scope, the information regarding the operation of the electronic scope, and the audio signal input to the electronic scope are included in the digital blanking period. Is superimposed on.

  Preferably, the imaging element has an image acquisition region for imaging the object to be observed and a masking region that is a peripheral part of the image acquisition region and masked on the front surface in the imaging region, and during the digital blanking period, If at least one of the information regarding the characteristics of the electronic scope, the information regarding the operation of the electronic scope, and the audio signal input to the electronic scope cannot be superimposed, in addition to the digital blanking period, the digital image data Of these, superposition is performed in the masking period corresponding to the image data obtained in the masking area.

  More preferably, if it is not possible to superimpose at least one of the information related to the characteristics of the electronic scope, the information related to the operation of the electronic scope, and the audio signal input to the electronic scope during the digital blanking period, the digital blanking. Information relating to the fact that superimposition has been performed in the masking period is added to the ranking period.

  Preferably, the information related to the characteristics of the electronic scope includes information related to a masking period for each line of the image sensor.

  Preferably, the signal is different between a period for outputting a composite video signal corresponding to the image signal obtained in the image acquisition area and a period for outputting the composite video signal corresponding to the image signal obtained in the masking area. A signal processing circuit that outputs an endoscope image display area identification signal to be output to the multiplexer is further provided, and superimposition timing control in the masking period is performed based on the endoscope image display area identification signal.

  An electronic scope of an electronic endoscope system according to the present invention has an image acquisition area for imaging an object to be observed, and a masking area that is a peripheral part of the image acquisition area and masked on the front surface. A digital image data obtained by time-division-multiplexing an image signal of an effective video period for each line of the image sensor obtained by the image sensor, and a synchronization word added before and after the digital image data; A multiplexer for outputting a digital signal having a digital blanking period generated between a synchronization word added after the digital image data and a synchronization word added before the digital image data in the next effective video period Provide at least one of the information on the characteristics of the electronic scope and the information on the operation of the electronic scope, and input to the electronic scope And a sound signal, a digital blanking period, is superimposed on at least one of the masking period corresponding to the image data obtained in the masking area of the digital image data.

  An electronic endoscope system according to the present invention includes an imaging element having an image acquisition area for imaging an object to be observed, and a masking area that is a peripheral part of the image acquisition area and masked on the front surface. , Digital image data obtained by time-division multiplexing of image signals in an effective video period for each line of the image sensor obtained by the image sensor, a synchronization word added before and after the digital image data, and digital image data And a digital blanking period generated between a synchronization word added after the digital image data in the next effective video period and information regarding the characteristics of the electronic scope, At least one of the information related to the operation of the scope and the audio signal input to the electronic scope include a digital blanking period and a digital image data. An electronic scope having a multiplexer that outputs a digital signal superimposed on at least one of the masking periods corresponding to the image data obtained in the masking area of the data, and information on the characteristics of the electronic scope in the digital signal, The image processing processor includes a video decoder that separates information related to the operation of the scope, an audio signal input to the electronic scope, and image data obtained in the image acquisition area of the digital image data.

  Preferably, the image processor is an image processing circuit that performs image processing that enables video output to the separated image data, and an audio signal processing circuit that performs audio signal processing that enables audio output to the separated audio signal And have.

  As described above, according to the present invention, it is possible to provide an electronic scope that transmits information as a digital signal to an image processor.

  Hereinafter, the configuration of the electronic endoscope system according to the present embodiment will be described with reference to the drawings. The electronic endoscope system 1 according to the present embodiment includes an electronic scope 10, an image processor 20, and a monitor 30 (see FIG. 1).

  The electronic scope 10 has an image sensor 11 in an insertion portion 10a which is a flexible tube inserted into a patient's body, and performs various operations while being held by a practitioner, and an image processing processor (image processing apparatus) 20. The operation and connection unit 10b connected to the A / D converter 12 includes an A / D converter 12, a first signal processing circuit 13, a multiplexer 14, a synchronization word generation circuit 15, an EEPROM 16, an encoder 17, and a first audio processing circuit 18.

  The image processor 20 includes a video decoder 21, a second signal processing circuit 22, a second audio processing circuit 23, a timing circuit 24, and a system control 25. The image processor 20 performs predetermined image processing on the image acquired by the electronic scope 10. In addition, predetermined audio signal processing is performed on an audio signal acquired by audio input means (not shown) such as a microphone connected to (or built in) the electronic scope 10.

  A monitor 30 is connected to the image processor 20. The monitor 30 is a display unit that displays an image that has been subjected to image processing by the image processor 20 and that is compliant with a predetermined analog video signal standard. In addition to the monitor 30, the image processor 20 may be connected to an external storage device that records image data processed by the image processor 20, a printer that outputs (prints out) an image, and the like.

  Next, the detail of each part is demonstrated. A light guide (not shown) made of a large number of optical fibers for guiding illumination light is inserted into the electronic scope 10, and the light guide extends to the tip of the insertion portion 10a of the electronic scope 10, and is an image processor. Light from a light source device (not shown) at 20 or the like is irradiated to the object to be observed as illumination light.

  The imaging region of the imaging device 11 has an image acquisition region 11a into which reflected light from the observation object is incident and a masking region 11b (see FIG. 2). The masking area 11b is an area in which the peripheral portion of the image acquisition area 11a cannot obtain a sufficient amount of light and image quality and can be imaged by the image sensor 11, but is masked on the front side and intentionally shielded. The shape and size of the masking region 11 b vary depending on the electronic scope 10 including the image sensor 11.

  Reflected light from the object to be observed enters the image acquisition region 11a of the image sensor 11 through an objective optical system (not shown), and an optical image of the object to be observed is formed on the incident surface of the image acquisition region 11a of the image sensor 11. Imaged. The image sensor 11 photoelectrically converts the incident optical image of the observed object and outputs an analog image signal based on the optical image.

  The first signal processing circuit 13 performs the previous image signal processing on the digital signal obtained by converting the analog image signal output from the image sensor 11 by the A / D converter 12, and sends the digital image signal (luminance signal) to the multiplexer 14. Y, a color difference signal Cr, Cb).

  For example, in the A / D converter 12, the luminance signal Y is converted into a digital signal at a sampling frequency of 13.5 MHz, and the color difference signals Cr and Cb are converted into a digital signal at a sampling frequency of 6.75 MHz. That is, A / D conversion is performed so that the ratio of these sampling frequencies is Y: Cr: Cb = 4: 2: 2. The number of samples in the effective video period of one line of the image sensor 11 is 720 samples for the luminance signal Y, 360 samples for the color difference signals Cr and Cb, and a total of 1440 samples.

  The first signal processing circuit 13 outputs an endoscope image display area identification signal to the multiplexer 14. The endoscope image display area identification signal was obtained in the image acquisition area 11a in the effective video period of one line of the image sensor 11 (the output period of the composite video signal corresponding to the image signal obtained by the image sensor 11). The signal is output during the output period of the composite video signal corresponding to the image signal, and the signal is output during the other period of High, and the period during which the endoscopic image display area identification signal is High is output during the effective video period of one line. (The output period of the composite video signal corresponding to the image signal obtained in the masking region 11b) is the masking period (see FIG. 2). The length of the masking period is different for each line of the image sensor 11.

  In the present embodiment, the first signal processing circuit 13 records information on the masking period corresponding to the characteristics of the image sensor 11 for each line of the image sensor 11, but is recorded in the EEPROM 16, and the first signal processing circuit 13 13 may read this information.

  For example, the period during which the composite video signal of the line of the image sensor 11 shown in (1) of FIG. 2 is output in the image sensor 11 is the masking region 11b in the entire effective video period (image signal output period). Since the composite video signal corresponding to the obtained image signal is output, the effective video period coincides with the masking period, and the endoscopic image display area identification signal continues to output High.

  Also, the period during which the composite video signal of the line of the image sensor 11 shown in (2) of FIG. 2 is output in the image sensor 11 is the masking region 11b at the first time t1 after the start and before the end of the effective video period. A composite video signal corresponding to the obtained image signal is output. Therefore, the first time t1 before and after the start of the effective video period is the masking period, and during that time, the endoscope image display area identification signal outputs High, and after the first time t1 has elapsed since the start of the effective video period. From the end of the effective video period until the first time t1 is performed.

  Further, the period during which the composite video signal of the line of the image sensor 11 shown in FIG. 2 (3) is output in the image sensor 11 is the masking region 11b at the second time t2 after the start of the effective video period and before the end. A composite video signal corresponding to the obtained image signal is output. Accordingly, the second time t2 after the start and end of the effective video period is a masking period, during which the endoscopic image display area identification signal outputs High, and after the second time t2 has elapsed since the start of the effective video period. To Low output from the end of the effective video period to the second time t2 (t1> t2).

  The multiplexer 14 generates a parallel digital signal and outputs it to the video decoder 21 of the image processor 20.

  The parallel digital signal includes digital image data obtained by time-division multiplexing image signals (luminance signal Y, color difference signals Cr, Cb) of the effective video period for each line obtained by the image sensor 11, and digital image data. Are generated between a synchronization word (synchronization identification code) added before and after the digital image data, and a synchronization word added after the digital image data and a synchronization word added before the digital image data in the next effective video period. And a digital blanking period (see FIG. 3). During the digital blanking period, the encoder 17 performs audio signals, button information (operation information) of the electronic scope 10 (freeze, copy button, etc.), and information (parameters, etc.) related to the characteristics of the electronic scope 10 recorded in the EEPROM 16. Are superimposed.

  The synchronization word is used to identify the start and end of the effective video period, the field, and the horizontal / vertical when reading the parallel digital signal in the video decoder 21.

  However, an audio signal or the like to be described later is superimposed (overwritten) in the masking period before the end of the effective video period. Even when an audio signal or the like is not superimposed, digital image data corresponding to this period (multiplexed data of image signals obtained by imaging in the masking area 11b) is used for display by the monitor 30. I can't.

  The multiplexing of the luminance signal Y or the like is performed in the order of Cb, Y, Cr, Y, Cb, Y, Cr,. In the present embodiment, a mode in which three signals of luminance signal Y and color difference signals Cr and Cb are multiplexed into one system will be described. However, two signals of color difference signals Cr and Cb are multiplexed into one system to obtain luminance. The signal Y and a total of two parallel digital signals may be output to the image processor 20.

  In addition, a parallel / serial converter (not shown) is provided in the subsequent stage of the multiplexer 14 of the electronic scope 10, and a serial / parallel converter (not shown) is provided in the previous stage of the video decoder 21 of the image processor 20, so that parallel digital signals are serialized. It may be transmitted to the image processor 20 after being converted into a signal. Also, differential transmission using two signal lines, or digital signal may be further compressed and transmitted with an output conforming to the IEEE 1394 standard.

  If the digital blanking period is not long enough and the audio signal cannot be superimposed in the digital blanking period, the audio signal is superimposed (overwritten) in the masking period in addition to the digital blanking period. The The superimposition timing control of the audio signal or the like in the masking period is performed based on the endoscope image display area identification signal. In addition, when an audio signal or the like is superimposed in the masking period, information regarding the audio signal or the like being superimposed in the masking period is added to the digital blanking period. The video decoder 21, which will be described later, reads information related to the superimposition of an audio signal or the like during this masking period, thereby reading the audio signal or the like superimposed during the masking period.

  The synchronization word generation circuit 15 outputs a synchronization word including an area identification signal for specifying a digital blanking period in the parallel digital signal to the multiplexer 14 and the encoder 17. The superimposition timing control of the audio signal or the like in the digital blanking period is performed based on this region identification signal.

  The EEPROM 16 records information (parameters) related to the characteristics of the electronic scope 10 such as information on the masking period for each line of the image sensor 11. Information relating to the characteristics of the electronic scope 10 recorded in the EEPROM 16 is superimposed by the encoder 17 on a digital blanking period or the like.

  An audio signal obtained by an audio signal input means (not shown) such as a microphone and processed by the first audio processing circuit 18 is combined with the operation and freeze information provided in the connection unit 10b, button information from a copy button, and the like. Is superimposed on the digital blanking period.

  A parallel digital signal and a synchronous clock are output from the electronic scope 10 to the image processor 20 (video decoder 21). The video decoder 21 specifies the digital blanking period in the parallel digital signal based on the synchronization clock and information from the timing circuit 24 (information on the characteristics of the electronic scope 10), and the information superimposed on the digital blanking period is displayed. Read it.

  Among the information regarding the characteristics of the electronic scope 10, initial information such as information for specifying the digital blanking period is electronic information in an initial setting in which the electronic scope 10 is connected to the image processor 20 and the power is turned on. It is transmitted from the scope 10 to the image processor 20.

  The digital blanking period is specified by turning on the power of the electronic endoscope system 1 and then inputting a signal from the synchronization word generation circuit 15 to the multiplexer 14 and adding a synchronization word (power on) State → Synchronization word addition (identification of digital blanking period) → Transmission of initial information regarding characteristics of electronic scope 10 recorded in EEPROM 16). Accordingly, the timing circuit 24 detects the synchronization word from the signal transmitted from the electronic scope 10 after the electronic endoscope system 1 is turned on, and then receives initial information regarding the characteristics of the electronic scope 10. .

  If the information related to the audio signal superimposed on the masking period is not added to the read digital blanking period information, the video decoder 21 converts the information superimposed on the digital blanking period to the parallel digital signal. The button information of the electronic scope 10 and the information related to the characteristics of the electronic scope 10 are sent to the timing circuit 24 and the audio signal is sent to the second signal processing circuit 23.

  If the information related to the audio signal or the like being superimposed also in the masking period is added to the information of the digital blanking period read out, the video decoder 21 is information superimposed on the digital blanking period and the masking period. Are separated from the parallel digital signal, button information of the electronic scope 10 and information on the characteristics of the electronic scope 10 are sent to the timing circuit 24 and the system control 25, and an audio signal is sent to the second signal processing circuit 23.

  A digital signal corresponding to an image signal obtained by imaging in the image acquisition region 11a in the parallel digital signal after separation is decoded by the video decoder 21, and amplified by the second signal processing circuit 22 to the digital image signal, gamma Subsequent image signal processing, such as correction and edge enhancement, is performed and stored as image data in an image memory (not shown) provided in the second signal processing circuit 22.

  The image data in the image memory provided in the second signal processing circuit 22 is read out in a timely manner and is subjected to video signal processing (image processing that enables video output) in accordance with the specifications of a predetermined video signal. 30. As a result, the observed object image is displayed on the monitor 30. When output to the monitor 30, a masked image (an image composed of a single color such as black or blue) is displayed in the portion corresponding to the image signal obtained by imaging in the masking region 11 b. The Also, the audio signal is processed by the second signal processing circuit 23 to enable audio output, and is output by the monitor 30 (or other audio reproduction device).

  The system control 25 is a microprocessor or the like that controls the entire electronic endoscope system 1, and controls each part of the image processor 20. For example, the system control 25 controls each part such as freeze control based on the button information of the electronic scope 10 sent from the video decoder 21.

  In the present embodiment, information that is transmitted from the electronic scope 10 to the image processor 20 such as information related to the characteristics of the electronic scope 10 and other than image data and audio signals is also a digital signal (parallel digital signal or serial digital signal). ) Can be transmitted.

  Also, information that is transmitted from the electronic scope 10 to the image processor 20 and other than image data such as an audio signal is transmitted not only in the digital blanking period but also in the masking period. For this reason, even large-volume information that cannot be superimposed only in the digital blanking period can be transmitted without increasing the number of signal lines. In addition, since information on whether or not the masking period is used for superimposition of the audio signal or the like is added to the digital blanking period, the information superimposed on the masking period is read by reading the information of the digital blanking period. It becomes possible to determine whether or not it is necessary.

  In the present embodiment, a description has been given of a mode in which an audio signal or the like is superimposed on the masking period in addition to the digital blanking period when the audio signal or the like cannot be superimposed on the digital blanking period. An audio signal or the like may be superimposed on at least one of the digital blanking period and the masking period without determining whether it can be superimposed on the ranking period. Even in this case, the blanking period is specified by the synchronization word, and the masking period is specified by the information related to the characteristics of the electronic scope 10 superimposed on the blanking period. It is possible to separate.

It is a block diagram of the electronic endoscope system in this embodiment. It is a figure which shows the relationship between a composite video signal, an endoscopic image display area identification signal, and the imaging area of an image sensor. It is a figure which shows the relationship between a composite video signal, an endoscopic image display area identification signal, and a parallel digital signal.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Electronic endoscope system 10 Electronic scope 10a Insertion part 10b Operation and connection part 11 Image pick-up element 11a Image acquisition area 11b Masking area 12 A / D converter 13 1st signal processing circuit 14 Multiplexer 15 Synchronous word generation circuit 16 EEPROM
17 Encoder 18 First Audio Processing Circuit 20 Image Processor 21 Video Decoder 22 Second Signal Processing Circuit 23 Second Audio Processing Circuit 24 Timing Circuit 25 System Control 30 Monitor

Claims (8)

An image sensor;
Digital image data obtained by time-division-multiplexing an image signal of an effective video period for each line of the image sensor obtained by the image sensor, a synchronization word added before and after the digital image data, and A multiplexer for outputting a digital signal having a digital blanking period generated between a synchronization word added after the digital image data and a synchronization word added before the digital image data in the next effective video period; An electronic scope of an electronic endoscope system comprising:
An electronic scope, wherein at least one of information relating to characteristics of the electronic scope, information relating to operation of the electronic scope, and an audio signal input to the electronic scope are superimposed on the digital blanking period. The imaging element has an image acquisition area for imaging the object to be observed and a masking area that is a peripheral part of the image acquisition area and masked on the front surface in the imaging area,
If it is not possible to superimpose at least one of the information related to the characteristics of the electronic scope, the information related to the operation of the electronic scope, and the audio signal input to the electronic scope during the digital blanking period, the digital scope 2. The electronic scope according to claim 1, wherein, in addition to a blanking period, the superposition is performed in a masking period corresponding to image data obtained in the masking region of the digital image data.   If it is not possible to superimpose at least one of the information related to the characteristics of the electronic scope, the information related to the operation of the electronic scope, and the audio signal input to the electronic scope during the digital blanking period, the digital scope 3. The electronic scope according to claim 2, wherein information relating to the fact that the superposition has been performed in the masking period is added to the blanking period.   The electronic scope according to claim 2, wherein the information related to the characteristics of the electronic scope includes information related to the masking period for each line of the image sensor. Different signal output is performed in a period in which a composite video signal corresponding to the image signal obtained in the image acquisition area is output and a period in which a composite video signal corresponding to the image signal obtained in the masking area is output. A signal processing circuit for outputting an endoscope image display region identification signal to the multiplexer;
The electronic scope according to claim 2, wherein the superimposition timing control in the masking period is performed based on the endoscopic image display area identification signal. An imaging element having an image acquisition area for imaging the object to be observed, and a masking area that is a peripheral part of the image acquisition area and masked on the front surface;
Digital image data obtained by time-division-multiplexing an image signal of an effective video period for each line of the image sensor obtained by the image sensor, a synchronization word added before and after the digital image data, and A multiplexer for outputting a digital signal having a digital blanking period generated between a synchronization word added after the digital image data and a synchronization word added before the digital image data in the next effective video period; An electronic scope of an electronic endoscope system comprising:
At least one of the information related to the characteristics of the electronic scope, the information related to the operation of the electronic scope, and the audio signal input to the electronic scope are the digital blanking period and the masking area of the digital image data. An electronic scope characterized by being superimposed on at least one of masking periods corresponding to obtained image data. An imaging element having an image acquisition area for imaging the object to be observed, a masking area that is a peripheral part of the image acquisition area and masked on the front surface, and the imaging obtained by the imaging element Digital image data obtained by time-division multiplexing of an image signal of an effective video period for each line of the element, a synchronization word added before and after the digital image data, and a synchronization added after the digital image data A digital blanking period generated between a word and a synchronization word added before the digital image data in the next effective video period, and information regarding characteristics of the electronic scope and operation of the electronic scope At least one of the information and the audio signal input to the electronic scope are the digital blanking period, the digital Said electronic scope and a multiplexer for outputting a digital signal superimposed on at least one of the masking period corresponding to the image data obtained by the masking area of the image data,
Information regarding the characteristics of the electronic scope in the digital signal, information regarding the operation of the electronic scope, an audio signal input to the electronic scope, and image data obtained in the image acquisition area of the digital image data And an image processing processor having a video decoder for separating the video endoscope.   The image processing processor includes: an image processing circuit that performs image processing that enables video output to the separated image data; and an audio signal processing circuit that performs audio signal processing that enables audio output to the separated audio signal The electronic endoscope system according to claim 7, further comprising:

Images