JP2006280792A - Image displaying device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To shorten the time for displaying a continuous image group even though there is a moving subject in the continuous image group in which an image of the same pick-up scene continues, as well as the time for observing the series of images inside the subject. <P>SOLUTION: An image displaying device for displaying a series of images inside the subject following in order of time is equipped with a calculation processing part 15a for calculating correlative values between a plurality of pixel regions that have been set on the series of images respectively and computing their movement vectors in a plurality of the pixel regions, an image detection part 15b for detecting a group of sequential images having correlative values larger than a prescribed value between neighboring images of a plurality of the pixel regions, and a frame rate controlling part 15c for specifying one or more representative images out of the sequential image groups and controlling the display of the one or more representative images at a displaying frame rate different from that of the remaining images. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image display device that displays a series of images in which a desired subject is captured in time series.

  In recent years, in the field of endoscopes, capsule endoscopes, which are swallowable endoscopes that are provided with an imaging function and a wireless communication function, have appeared, and a subject that has been imaged by the capsule endoscope has been introduced. A capsule endoscope system that acquires image data in a specimen has been developed. In this capsule endoscope system, the capsule endoscope is swallowed from the subject's mouth for observation (examination) until it is naturally discharged from the subject. For example, the inside of an organ such as the stomach or the small intestine moves in accordance with the peristaltic motion, and functions to image the inside of the subject at a predetermined interval, for example, an interval of 0.5 seconds.

  While the capsule endoscope moves in the subject, image data captured by the capsule endoscope is sequentially transmitted to the outside by wireless communication, and is transmitted to the receiving device via a receiving antenna provided outside. Received. This receiving apparatus reconstructs image data based on radio signals sequentially received via the receiving antenna, and thereby can acquire image data in the subject by the capsule endoscope. This receiving apparatus sequentially stores acquired image data in a memory. The subject can freely act by carrying the receiving device having the wireless communication function and the memory function from when the capsule endoscope is swallowed to when the capsule endoscope is naturally discharged. Thereafter, an examiner such as a doctor or a nurse loads the image data stored in the memory of the receiving device into the image display device, and an image in the subject, for example, an organ image based on the obtained image data, is stored in the image display device. Display on the display. The examiner can observe the organ image displayed on the display and diagnose the subject.

  Such an image display device generally has a processing function for sequentially displaying a series of images taken by a capsule endoscope in time series. For example, when an image of a region to be observed in the subject is displayed, the examiner performs an operation of reproducing the image at a low speed in order to carefully observe the image. In addition, when an image other than the region to be observed is displayed, the examiner performs an operation of reproducing the image at high speed in order to shorten the time for observing a series of images in the subject. With regard to such a technique, the degree of similarity of images between adjacent images of a series of images to be sequentially displayed is measured, and when the obtained degree of similarity is high, each frame having a high degree of similarity is displayed by increasing the display frame rate. Images that are displayed at high speed or images with high similarity are excluded (image cut) from the display target, and when the obtained similarity is low, the display frame rate is reduced to display each image with low similarity at low speed There is a display device (see Patent Document 1).

US Pat. No. 6,709,387

  By the way, the organs in the subject repeatedly perform pulsation or peristalsis for life support. For this reason, most capsule endoscopes sequentially image a dynamic subject in a subject. Therefore, in a series of images in a subject imaged by a capsule endoscope, images of dynamic subjects whose modes are sequentially changed according to pulsation or peristaltic movement are often continuous, even in the same imaging scene. Even if the images are consecutive, it is rare that images of the same subject captured in the same manner are consecutive.

  However, in the image display device described in Patent Document 1 described above, in a continuous image group in which images of the same captured scene are continuous, if the images in which the same subject is captured in the same manner are not continuous, this continuous image group In many cases, it is difficult to capture each of the images as an image having a high degree of similarity between adjacent images. For this reason, when sequentially displaying a series of images in the subject, the display time of a continuous image group in which images of the same imaging scene are continuous cannot be shortened as expected, and the observation time of the series of images in the subject is shortened. There was a problem that it was difficult.

  The present invention has been made in view of the above circumstances, and even when there is a subject movement in a continuous image group in which images of the same imaging scene are continuous, the display time of the continuous image group can be shortened. An object of the present invention is to provide an image display device that can shorten the observation time of a series of images in a subject.

  In order to solve the above-described problems and achieve the object, an image display device according to claim 1 is an image display device that displays a series of images taken in time series, and each image of the series of images. An arithmetic means for calculating a correlation value of a plurality of pixel areas set above and calculating a motion vector of the plurality of pixel areas, and an image in which the correlation values of the plurality of pixel areas between adjacent images are equal to or greater than a predetermined value Means for detecting a continuous image group, and one or more representative images are identified from the continuous image group, and the one or more representative images are displayed at a display frame rate different from that of the remaining images other than the one or more representative images. And a frame rate control means for controlling the display of the representative image.

  According to a second aspect of the present invention, in the above invention, the frame rate control means excludes the remaining images.

  According to a third aspect of the present invention, in the above invention, the frame rate control means performs control to display the remaining image at a display frame rate higher than that of the one or more representative images. It is characterized by.

  According to a fourth aspect of the present invention, in the above invention, the calculation unit calculates a vector addition value obtained by adding the motion vectors for each of the plurality of pixel regions in each direction, and the frame rate control unit includes: The image group representing the reciprocal motion of each pixel area is specified as the one or more representative images based on the vector addition value.

  According to a fifth aspect of the present invention, in the above invention, the frame rate control means excludes an image in which a motion vector of each pixel region is less than a predetermined size.

  According to a sixth aspect of the present invention, in the above invention, the frame rate control means compares the image in which the motion vector of each pixel region is less than a predetermined size with respect to the one or more representative images. The display is controlled at a high display frame rate.

  According to a seventh aspect of the present invention, in the above invention, the one or more representative images include at least a first image of the continuous image group.

  The image display device according to claim 8 is characterized in that, in the above invention, the one or more representative images represent a part of a motion or a peristaltic motion of a subject imaged in the continuous image group. To do.

  According to the present invention, even when there is a movement of a subject in a continuous image group in which images of the same imaging scene are continuous, one or more representative images representing the continuous image group can be displayed, and the continuous image group The display time can be shortened and an image display device that can shorten the observation time of a series of images in the subject can be realized.

  Preferred embodiments of an image display device according to the present invention will be described below in detail with reference to the drawings. The present invention is not limited to the embodiments.

(Embodiment 1)
FIG. 1 is a schematic view schematically illustrating a configuration example of a capsule endoscope system using an image display apparatus according to Embodiment 1 of the present invention. As shown in FIG. 1, the capsule endoscope system includes a capsule endoscope 2 that moves along a passage route in the subject 1 and captures an image in the subject 1, and a capsule endoscope. A receiving device 3 that receives image data transmitted from the mirror 2, an image display device 4 that displays an image in the subject 1 imaged by the capsule endoscope 2, a receiving device 3, and an image display device 4 And a portable recording medium 5 for transferring information between them.

  The capsule endoscope 2 has an imaging function for imaging the inside of the subject 1 and a wireless communication function for transmitting image data obtained by imaging the inside of the subject 1 to the receiving device 3. The capsule endoscope 2 passes through the esophagus in the subject 1 by being swallowed by the subject 1, and advances in the body cavity by the peristaltic movement of the digestive tract cavity. At the same time, the capsule endoscope 2 sequentially captures images in the body cavity of the subject 1 at predetermined intervals, for example, 0.5 second intervals, and sequentially obtains the image data in the subject 1 to the receiving device 3. Send.

  Note that the capsule endoscope 2 sequentially changes the imaging scene in the subject 1 each time the capsule endoscope 2 moves forward, backwards, or rotates in the subject 1. For this reason, when the capsule endoscope 2 moves forward, backward, or rotates in the subject 1 and repeats the imaging process, the capsule endoscope 2 sequentially captures images of different imaging scenes in the subject 1. In this case, in a series of images captured by the capsule endoscope 2, images of different imaging scenes in the subject 1 are continuous. On the other hand, the capsule endoscope 2 sequentially captures images of the same imaging scene in the subject 1 when the imaging process is repeated in a stationary state in the subject 1. In this case, in a series of images captured by the capsule endoscope 2, images of the same imaging scene in the subject 1 are continuous.

  The receiving device 3 is connected to the receiving antennas 3a to 3h, and performs wireless communication with the capsule endoscope 2 using the receiving antennas 3a to 3h. Specifically, the receiving device 3 receives a radio signal from the capsule endoscope via any one of the receiving antennas 3a to 3h, and acquires image data in the subject 1 based on the received radio signal. get. The receiving device 3 is detachably mounted with a portable recording medium 5, and sequentially stores image data in the subject 1 acquired sequentially from the capsule endoscope 2 in the portable recording medium 5.

  The receiving antennas 3a to 3h are realized by using, for example, a loop antenna, and receive a radio signal transmitted from the capsule endoscope 2. As shown in FIG. 1, the receiving antennas 3 a to 3 h are arranged at predetermined positions on the body surface of the subject 1, for example, at positions corresponding to the passage route of the capsule endoscope 2. The receiving antennas 3a to 3h may be arranged at predetermined positions of a jacket to be worn by the subject 1. In this case, the receiving antennas 3a to 3h are arranged at predetermined positions on the body surface corresponding to the passage route of the capsule endoscope 2 of the subject 1 when the subject 1 wears this jacket. The subject 1 may be provided with a plurality of receiving antennas. In this case, the number of receiving antennas is not particularly limited to eight.

  The portable recording medium 5 is a portable recording medium such as a compact flash (registered trademark) or an SD memory card. The portable recording medium 5 is detachable from the receiving device 3 and the image display device 4 and has a structure capable of outputting and recording information when mounted on both. Specifically, when the portable recording medium 5 is attached to the receiving device 3, it can sequentially store image data and the like acquired from the capsule endoscope 2 by the receiving device 3. The portable recording medium 5 is taken out from the receiving device 3 after the capsule endoscope 2 is ejected from the subject 1 and attached to the image display device 4, and the stored image data or the like is stored in the image display device 4. Is taken in.

  The image display device 4 is for displaying an image taken by the capsule endoscope 2 and is based on image data obtained through the portable recording medium 5, for example, in the subject 1. It has a configuration such as a workstation that displays an image of an organ or the like. Further, the image display device 4 has a processing function for an inspector such as a doctor or a nurse to make a diagnosis based on the image in the subject by the capsule endoscope 2. The examiner can diagnose the subject 1 by sequentially displaying the images in the subject 1 on the image display device 4 and observing (inspecting) a desired site in the subject 1 based on the displayed images. .

  FIG. 2 is a block diagram schematically showing a configuration example of the image display device 4. As shown in FIG. 2, the image display device 4 includes an input unit 11 for inputting various information for displaying and observing an image captured by the capsule endoscope 2, and an image in the subject 1. The display unit 12 displays various information for observing (inspecting) the inside of the subject 1 and making a diagnosis, and the reader / writer 13 that captures image data stored in the portable recording medium 5. The image display device 4 also stores a storage unit 14 that stores various data necessary for observation and diagnosis of the subject 1 such as image data captured from the portable recording medium 5, and drives each component of the image display device 4. And a control unit 15 that performs input / output control and information processing of various information input / output to / from each component.

  The input unit 11 is realized by using a pointing device such as a keyboard or a mouse or a combination thereof, and controls instruction information for processing performed by the image display device 4 and various types of information regarding the subject 1 in accordance with an input operation by the examiner. Input to unit 15. For example, the input unit 11 indicates instruction information for instructing processing for storing image data captured from the portable recording medium 5 in the storage unit 14, and instruction information for instructing processing for displaying an image in the subject 1 on the display unit 12. , And patient information such as the name, sex, date of birth, or patient ID of the subject 1 is input to the control unit 15.

  The display unit 12 is realized by using various displays such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display, and displays various information instructed to be displayed by the control unit 15. For example, the display unit 12 displays an image in the subject 1 captured by the capsule endoscope 2, patient information, and the like as various information for examining and diagnosing the subject 1.

  The reader / writer 13 detachably attaches the above-described portable recording medium 5 and exchanges various data with the attached portable recording medium 5. Specifically, the reader / writer 13 takes in information stored in the attached portable recording medium 5, for example, image data by the capsule endoscope 2 and transfers the obtained image data to the control unit 15. . In addition, the reader / writer 13 has a function of recording input information from the control unit 15 and a function of performing format processing on the mounted portable recording medium 5.

  The storage unit 14 is realized by using various IC memories such as RAM or EEPROM, a hard disk, or the like. Further, the storage unit 14 has a structure in which an optical disk such as a CD (Compact Disk) or DVD (Digital Versatile Disk) or a magneto-optical disk is detachably mounted, and image data or the like is stored in the mounted CD or DVD. You may implement | achieve using the drive in which reading or writing is possible. The storage unit 14 stores various types of information such as image data instructed to be stored by the control unit 15 on itself or on various types of discs loaded. In addition, the storage unit 14 reads information stored in itself or information stored in various mounted discs, which is instructed to be read by the control unit 15, and transmits the information to the control unit 15.

  The control unit 15 controls the drive of the input unit 11, the display unit 12, the reader / writer 13, and the storage unit 14, the input / output control of information with respect to each of these components, and various operations between these components. It functions to perform information processing for inputting and outputting information. The control unit 15 includes an arithmetic processing unit 15a, an image detection unit 15b, and a frame rate control unit 15c.

  The arithmetic processing unit 15a calculates a correlation value, for example, a normalized cross-correlation value of a plurality of pixel regions set on each image of a series of images captured by the capsule endoscope 2, and each adjacent image in the series of images. The motion vector of each pixel area between images is calculated. Note that the pixel area referred to here is an area constituted by one or more pixel blocks on the image. Based on the correlation value of each pixel area calculated by the arithmetic processing unit 15a, the image detection unit 15b detects a continuous image group in which images with high similarity are consecutive from the series of images. Based on the motion vector derived by the arithmetic processing unit 15a, the frame rate control unit 15c specifies one or more representative images to be displayed as an observation target on the display unit 12 in the continuous image group. The frame rate control unit 15c sets the display frame rate of the image displayed on the display unit 12, and controls the display unit 12 to display the image at the set display frame rate.

  FIG. 3 is a flowchart for explaining a processing procedure for specifying one or more representative images from a continuous image group in which images having a high degree of similarity among a series of images are continuous. FIG. 4 is a schematic diagram for explaining the operation of a motion vector calculation process for calculating the motion vectors of a plurality of pixel areas set on each image. The control unit 15 determines whether an imaging scene of each image data of a series of images in the subject 1 captured by the capsule endoscope 2 has changed between the adjacent images, and images are captured between the adjacent images. If it is determined that the scene has changed, a scene change mark that is a flag for specifying that the image data of the rear side of the adjacent image group having a different imaging scene is an image of the imaging scene different from the immediately preceding image (Hereinafter referred to as SCH mark). In addition, when the control unit 15 determines that the captured scenes are the same between the adjacent images, the control unit 15 determines that the rear image data of the adjacent image group of the same captured scene is an image cut target image. A skip mark (hereinafter referred to as SK mark), which is a flag for specifying, is added. The control unit 15 assigns the SK mark or the SCH mark to each image data in this way, thereby displaying the display unit 12 as an observation target from a continuous image group in which a series of images having a high degree of similarity are consecutive. One or more representative images to be displayed are specified.

  That is, in FIG. 3, the control unit 15 reads each image data of a series of images in the subject 1 from the reader / writer 13 based on the instruction information input from the input unit 11 (step S101), and the read image data Motion vector calculation processing for calculating each motion vector of the plurality of upper pixel regions is performed (step S102). In this case, the arithmetic processing unit 15a uses the image data read by the control unit 15 and the immediately preceding image data adjacent to the image data, and calculates the motion vectors of a plurality of pixel areas on the image data. To do.

Specifically, when the arithmetic processing unit 15a calculates the motion vectors of a plurality of pixel areas on the image data D _n (n: positive integer) read by the control unit 15, as shown in FIG. In addition, pixel data D _n− for a plurality of pixel areas EA _n−1 , EB _n−1 , EC _n−1 , and ED _n−1 set on the immediately preceding image data D _n−1 adjacent to the image data D _{n. 1} , D _n , for example, a normalized cross-correlation value is calculated, and pixel areas EA _n−1 , EB _n−1 , EC _n−1 , EC _n−1 , among all pixel areas on the image data D _n are calculated. A plurality of pixel areas EA _n , EB _n , EC _n , and ED _n each having a maximum correlation value with respect to ED _n−1 are detected. Processing unit 15a sets the plurality of pixel areas _{EA n, EB n, EC n} , the ED _n as a pixel area of the image data D _n, as shown in FIG. 4, the pixel region EA _n-1, each vector shown _{EB n-1, EC n-} 1, ED n-1 pixel areas EA _n on the image data _{D n, EB n, EC n} , a movement direction and a movement amount in the case of moving the respective ED _n Are calculated and output as motion vectors VA _n , VB _n , VC _n , VD _n of the pixel areas EA _n , EB _n , EC _n , ED _n .

When the control unit 15 reads the _first image data D ₁ of the series of images in step S101, the arithmetic processing unit 15a has a plurality of pixels at a desired position on the image data D ₁ in step S102. Set the area. In this case, a plurality of pixel regions on the first image data D ₁ of the is set as a pixel area having a predetermined correlation value less than the threshold T1. The arithmetic processor 15a, when setting a plurality of pixel regions on the first image data D ₁ of the, for the frame center of the image data D ₁ from the position, for example the frame center are symmetrical in each position or frame of the cross direction It is desirable to set a pixel area at each position in the diagonal direction. This is because by setting a plurality of pixel areas on the leading image data D ₁ in such a positional relationship, it is easy to capture the motion of the subject in a series of continuous images of a series of images by each motion vector.

Next, based on the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , ED _n on the image data D _n described above, the control unit 15 determines that the image data D _n is the previous image data. It is determined whether the similarity is high with respect to D _n−1 . In this case, the image detection unit 15b compares the preset threshold value T1 with the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n to determine whether there is a correlation value less than the threshold value T1. Is determined (step S103). Here, when the image data D _n has a high similarity to the image data D _n−1 , the correlation values of the pixel areas EA _n , EB _n , EC _n , and ED _n are all equal to or greater than the threshold T1. . Therefore, when the image detection unit 15b determines in step S103 that there is no correlation value less than the threshold T1 in the correlation values of the pixel areas EA _n , EB _n , EC _n , and ED _n (step S103, No), the control unit 15 Determines that the image data D _n has high similarity to the image data D _n−1 . In this case, the image detection unit 15b detects image data D _n−1 and D _n having a high degree of similarity as a continuous image group in which images having correlation values of a plurality of pixel areas equal to or greater than the threshold T1 are continuous.

When the image data D _n−1 and D _n have high similarity, the control unit 15 determines whether the image data D _n−1 and D _n having high similarity are image data of the same imaging scene. Determine whether. In this case, the frame rate control unit 15c determines whether or not the motion vectors VA _n , VB _n , VC _n , and VD _{n of the} image data D _n having a high similarity are aligned in the same direction (step S104). .

Here, when the image data D _n-1 and D _n are image data of the same imaging scene and the subject of the same imaging scene performs a periodic biological motion between the image data D _n-1 and D _n , There is a high possibility that at least one of the motion vectors VA _n , VB _n , VC _n , VD _n has a different direction from the remaining motion vectors. Therefore, when the frame rate control unit 15c determines in step S104 that the motion vectors VA _n , VB _n , VC _n , and VD _n are not aligned in the same direction (step S104, No), for example, the motion vector VA _n , When at least one of VB _n , VC _n , and VD _n has a different direction from the remaining motion vectors, the control unit 15 causes the image data D _n−1 and D _n having high similarity to each other to be images of the same imaging scene. Judge as data. In this case, the frame rate control unit 15c performs SK marking treatment for imparting SK marks described above for image data D _n-1 and the image data D _n of the same image scene (step S105). In this case, the frame rate control unit 15c adds the SK mark to the image data D _n having a high similarity to the image data D _n−1 so that each correlation value of the plurality of pixel regions is equal to or greater than the threshold T1. Of the continuous image group in which the images are continuous, each image corresponding to the image data D _n-1 and D _n can be specified as each image repeating the same imaging scene. The control unit 15 stores the image data D _n to which the SK mark is added in the storage unit 14 by the SK mark adding process in step S105.

  Note that the above-described periodic biological motion of the subject is a motion of an organ that is periodically repeated in order for a human to live, and is, for example, a motion by a pulsation or a peristaltic motion. This movement due to the pulsation is a periodic movement in which the pulsation performed by the heart is transmitted and the organ repeats instantaneously. This peristaltic motion is a periodic motion that repeats enlargement / reduction based on the center of the cross section in order for the organ to move the contents. Specifically, when the capsule endoscope 2 sequentially captures an object that repeats movement due to pulsation, for example, the inside of the esophagus, in the captured continuous image group, the inside of the esophagus that is the object changes depending on the pulsation. The changing movement is repeated periodically. Further, when the capsule endoscope 2 sequentially captures a subject that repeats peristaltic motion, for example, the inside of the small intestine, in the captured continuous image group, the inside of the small intestine that is the subject repeats periodic motion according to the peristaltic motion.

Specifically, when the subject in the same imaging scene, that is, the organ in the subject 1 performs periodic biological motion between the image data D _n-1 and D _n in which images of the same imaging scene are continuous, this image at least one of the data D _n on the motion vectors _{VA n, VB n, VC n} , VD n , as described above, is likely to have a direction different from the rest of the motion vector. For example, when this periodic biological motion is a peristaltic motion, the motion vectors VA _n , VB _n , VC _n , and VD _n have directions radiating from the center of the frame, as illustrated in FIG.

On the other hand, when the image detection unit 15b determines in step S103 described above that the correlation values of the pixel areas EA _n , EB _n , EC _n , and ED _{n have} a correlation value less than the threshold T1 (Yes in step S103). ), the control unit 15, as image data D _n is less similarity to the image data D _n-1, i.e., it is determined that the image data D _n-1 as the image data of different image scene. Note that, as described above, a pixel area having a correlation value less than the threshold value T1 is set in the _first image data D1 of the series of images in the subject 1. Therefore, the image detecting unit 15b determines that the plurality of pixel areas on the image data D ₁ is a correlation value less than the threshold T1.

When the frame rate control unit 15c determines that the motion vectors VA _n , VB _n , VC _n , and VD _n are aligned in the same direction in step S104 described above (Yes in step S104), the control unit 15 Then, it is determined that the image data D _n−1 and D _n having a high degree of similarity are image data of different imaging scenes. Here, when the motion vectors VA _n , VB _n , VC _n , VD _n are aligned in the same direction, the subject of the image data D _{n −1} is translated while maintaining substantially the same mode in the image data D _n . is doing. This is because, for example, the capsule endoscope 2 moves laterally in the subject 1 to change the imaging scene and sequentially perform imaging processing. In this case, the image data D _n-1 and D _n are image data of different shooting scenes.

Thereafter, the frame rate control unit 15c, to the control unit 15 the image data D _n-1 different from the image data D _n or leading image data D ₁ of the it is determined to be of an imaging scene by the SCH marks described above An SCH mark providing process is performed (step S106). The control unit 15 stores the image data D ₁ and D _n to which the SCH mark is added in the storage unit 14 by the SCH mark adding process in step S106.

When the frame rate control unit 15c completes Step S105 or S106, the control unit 15 determines whether or not the processing up to Step S105 or S106 described above has been completed for all the image data of the series of images to be processed. (Step S107). In this case, for example, if the image data D _{n on} which the above-described step S105 or S106 has been performed is not the last image data in a series of images, the control unit 15 has completed the processing for all the image data. It is determined that there is not (step S107, No), and the next image data D _{n + 1} is read (step S108). Thereafter, the control unit 15 repeats the processing procedure after step S102 described above using the image data Dn _{+ 1} . On the other hand, for example, if the image data D _n on which step S105 or S106 described above has been performed is the last image data in a series of images, the control unit 15 determines that the processing has been completed for all image data. (Step S107, Yes), the processing procedure after step S102 described above is terminated.

  The control unit 15 repeats the processing procedure after step S101 described above as necessary, so that the imaging time of an adjacent image group in which images of different imaging scenes are adjacent among a series of images in the subject 1 is determined. An SCH mark is given to the rear image data, and an SK mark is given to the image data of the rear side of the adjacent image group in which the images of the same imaging scene are adjacent. In this case, the control unit 15 can add the SCH mark to the image data of one or more representative images in the continuous image group in which images with high similarity are continuous. One or more representative images can be identified. FIG. 5 is a schematic diagram for explaining an operation of specifying one or more representative images by adding an SK mark or an SCH mark to each image data of a series of image data.

As shown in FIG. 5, the control unit 15 performs, for example, the image data D ₁ , D ₂ , D ₃ , D ₄ , D ₅ , D ₆ , D of a series of images in the processing procedure of steps S101 to S108 described above. ₇ , D ₈ , D ₉ ,. Arithmetic processor 15a, the control unit the respective image data D ₁ read by _{15, D 2, D 3,} D 4, D 5, D 6, D 7, D 8, D 9, ... to, the above-described The motion vector calculation process of step S102 is sequentially performed. In FIG. 5, among the image data of a series of images, the leading image data D ₁ , the image data D _{2 of} an imaging scene different from the image data D _1, and the image data D _{3 of an} imaging scene different from the image data D ₂ , the image data D ₃ and different image data D ₄ of the image pickup scene, the image data D ₄ and the image data D ₅ to D ₇ of the same image scene, the image data D ₈ with a different image scene image data D _7, the image data D ₈ It illustrates image data D ₉ of the image scene that is different from the.

In this case, the image detecting unit 15b in step S103, it is determined that there is a correlation value less than the threshold T1 to the correlation values of a plurality of pixel regions on the first image data D ₁ of the, the image data D _2, D ₃ of It is determined that there is a correlation value less than the threshold value T1 among the correlation values of the plurality of pixel regions. Further, the image detecting unit 15b determines that there is a correlation value less than the threshold T1 to the correlation value of the plurality of pixel areas on the image data D _4, the correlation values of a plurality of pixel areas on the image data D ₅ to D ₇ Are all equal to or greater than the threshold value T1. Thereby, the image detecting unit 15b, a successive image group DG to image correlation values of the plurality of pixel areas is the threshold value T1 or more consecutive image data D ₄ to D ₇ highly similar to each other between adjacent images It can be detected. In this case, successive image group DG the image data D ₄ having a correlation value less than the threshold T1 to the beginning of the image, the successive image group of successive later image data D ₅ to D ₇ all the correlation value is the threshold value T1 or more It is. On the other hand, the image detecting unit 15b determines that there is a correlation value less than the threshold T1 to the correlation value of the plurality of pixel areas on the image data D _8, the threshold to the correlation values of a plurality of pixel areas on the image data D ₉ T1 Judge that there is a correlation value of less than.

On the other hand, the frame rate control unit 15c, the image data D ₁ to D ₃ in which it is determined that there is a correlation value less than the threshold T1 by the image detecting unit 15b, SCH marks performs SCH marking process of step S106 described above Are given respectively. The frame rate control unit 15c performed among the detected successive image group DG by the image detecting unit 15b, the image data D ₄ having a correlation value less than the threshold T1, the SCH marking process of step S106 described above To give an SCH mark. Further, the frame rate control unit 15c sequentially performs the steps S104 described above for the image data D ₅ to D ₇ total correlation value is the threshold value T1 or more, the same image data D ₅ to D ₇ and the image data D ₄ In the case of an imaged scene, the SK mark is added to the image data D _{5 to} D ₇ by applying the SK mark applying process in step S105 described above. Further, the frame rate control unit 15c applies the SCH mark applying process of step S106 described above to the image data D ₈ and D ₉ having a correlation value less than the threshold value T1, and assigns the SCH mark.

The frame rate control unit 15c of the successive image group DG as described above, image data D ₅ to D by applying SK mark to the image data D ₅ to D ₇ to repeat the image data D ₄ the same image scene ₇ as well as specific as the image data of the image cut target, it can identify the image data D ₄ as a representative image of the successive image group DG. The frame rate control unit 15c adds a SK mark to each image data that repeats the image of the same imaging scene in a series of images, thereby displaying a display target for each continuous image group in which images having high similarity are consecutive. A representative image can be specified. At the same time, the frame rate control unit 15c does not depend on the movement of the subject between the adjacent images, for example, even when the subject repeats periodic biological motion in the continuous image group DG, It is possible to specify each image data that repeats images of the same imaging scene as an image cut target.

  Next, the display screen of the display unit 12 is specifically illustrated, and the operation in which the control unit 15 displays the image in the subject 1 on the display unit 12 will be described in detail. FIG. 6 is a schematic view specifically illustrating the display screen of the display unit 12. When the examiner performs a login operation or the like using the input unit 11, the control unit 15 displays a window W for displaying various information for the examiner to observe and diagnose the subject as shown in FIG. Is displayed on the display unit 12.

  In the window W, a main image display area A1 for displaying an image in the subject 1 imaged by the capsule endoscope 2 and a desired image selected from the images in the main image display area A1 are displayed as thumbnail images. The sub-image display area A2 is formed. In the window W, the reproduction operation icon group 100 for performing various reproduction operations of the image displayed in the main image display area A1, and the elapsed time from the start of imaging of a series of images displayed in the main image display area A1 are displayed. A time scale TS shown and a slider S indicating the elapsed time from the start of imaging of the image displayed in the main image display area A1 are formed on the time scale TS. Further, a scroll bar B for performing a scroll operation of the thumbnail image in the sub-image display area A2 is displayed in the window W. In addition, in the window W, patient information such as the patient ID, sex, name and date of birth of the subject 1 and a “close” icon 110 for performing an operation of closing the window W are formed.

  Further, as the reproduction operation icon group 100, a “re” icon 101 for reproducing an image in a forward direction at a standard display frame rate, and an image in a forward direction at a display frame rate that is lower than the standard display frame rate. “Frame” icon 102 for playback, “High re” icon 103 for playback of images in the forward direction at a display frame rate higher than the standard display frame rate, and reverse image at the standard display frame rate "Reverse replay" icon 104 for reproducing in the direction, "Reverse frame" icon 105 for reproducing the image in the reverse direction at a display frame rate lower than the standard display frame rate, and the standard display frame rate Compared to the “High-Reverse” icon 106 for playing an image in the reverse direction at a higher display frame rate, and to pause the playback of the image "One stop" icon 107 is formed of. The examiner operates the input unit 11, for example, moves the cursor K to any position of the reproduction operation icon group 100 and performs a click operation, and instructs the subject 1 to reproduce or pause the image. In this case, the input unit 11 inputs image display instruction information corresponding to one of the reproduction operation icon groups 100 to the control unit 15, and the control unit 15 receives the image display instruction information. The frame rate control unit 15c sets the display frame rate based on the image display instruction information, and sequentially displays a desired number of images at the display frame rate set based on the image display instruction information on the display unit 12. Take control.

  The standard display frame rate described above is a display frame rate that allows a series of images to be reproduced in a pseudo moving image. Further, the low-speed display frame rate described above is a display frame rate at which the display time for each unit frame is longer than that of the standard display frame rate, and a series of images can be easily observed for each frame. Furthermore, the high-speed display frame rate described above is a display frame rate that shortens the display time for each unit frame as compared with the standard display frame rate. Hereinafter, a display frame rate based on image display instruction information corresponding to any of the reproduction operation icon groups 100 is referred to as a normal setting display frame rate. That is, the normal display frame rate is one of the standard, low speed, and high speed display frame rates described above.

Next, an operation in which the frame rate control unit 15c sequentially displays a series of image data in the subject 1 will be described. FIG. 7 is a flowchart for explaining a processing procedure for sequentially displaying a series of image data provided with the SCH mark or SK mark. In FIG. 7, when the control unit 15 receives the above-described image display instruction information from the input unit 11, the frame rate control unit 15 c uses the image display instruction information as a trigger to start a series of items in the subject 1 from the storage unit 14. Image data D _n of the image is read (step S201).

Thereafter, the frame rate control unit 15c, to the image data D _n, determines which of SK marks and SCH mark described above is applied (step S202). In step S202, the frame rate control unit 15c determines that this case of detecting the SCH mark from image data D _n, marks assigned to the image data D _n is SCH mark (step S202, SCH mark) Then, the display frame rate of the image data D _n is determined to be the above-described normal display frame rate (step S203).

Next, the frame rate control unit 15c, using the image data D _n the SCH mark is assigned, to the display unit 12, the display frame rate of the image inside the subject 1 corresponding to the image data D _n normal setting Is displayed (step S205). Thus, an image inside the subject 1 corresponding to the image data D _n is reproduced on the display unit 12 in the display time corresponding to the display frame rate of the normal setting.

Thereafter, the frame rate control unit 15c determines whether or not the reproduction of all the images of the subject 1 designated for display by the examiner has been completed on the display unit 12 (step S206). In step S206, the frame rate control unit 15c, the image data D _n is not the last image data of a series of images, and still play complete all images of the subject 1 that is specified display example was processed in step S202 determining that non (step S206, no), read the next image data D _{n + 1} of the image data D _n from the storage unit 14 (step S207). In this case, the frame rate control unit 15c repeats the processing procedure from step S202 onward for the next image data D _{n + 1} read in step S207. That is, the frame rate control unit 15c sequentially repeats the processing procedure after step S202 described above for each of a series of all image data designated for display.

On the other hand, the frame rate control unit 15c, when detecting the SK mark from image data D _n in step S202 described above, determines that the mark image data D _n granted to is SK mark (step S202, SK mark ), This image data D _n is excluded from image display targets (step S204). Thereafter, the frame rate control unit 15c repeats the processing procedure after step S206 described above. As a result, the image of the subject 1 corresponding to the image data D _n to which the SK mark is added is cut off without being reproduced on the display unit 12.

Note that in step S206 described above, the frame rate control unit 15c, for example, when the image data D _n of processing in step S202 is the last image data of a series of images, all the images inside the subject 1 that is designated display It is determined that the reproduction has been completed (step S206, Yes), and the processing procedure for sequentially displaying a series of image data in the subject 1 designated for display is terminated.

Here, using image data D ₁ to D ₉ of the subject 1 shown in FIG. 5 described above, the frame rate control unit 15c will be described a specific example of operation for sequentially displaying the series of images of the subject 1. In step S201 to S207, the frame rate control unit 15c, for example, sequentially reads image data D ₁ to D ₉ of the subject 1. Among these image data D _{1 to} D ₉ , the SCH mark is given to the image data D _{1 to} D ₃ as described above. Therefore, the frame rate control unit 15c sequentially determines the display frame rates of the image data D _{1 to} D ₃ as normal display frame rates corresponding to any of the reproduction operation icon groups 100 described above, and displays them on the display unit 12. On the other hand, control is performed to sequentially display the image data D _{1 to} D ₃ at the display frame rate set at the normal setting.

In addition, as described above, the SCH mark is given to the image data D ₄ in the continuous image group DG in which images with high similarity are continuous. Accordingly, the control frame rate control unit 15c determines the display frame rate of the image data D ₄ to the display frame rate of the normal setting, to the display unit 12, an image displaying the image data D ₄ in the display frame rate of the normal setting I do. On the other hand, in the continuous image group DG, the SK mark is given to the image data D _{5 to} D ₇ as described above. Thus, the frame rate control unit 15c to force regardless of the image display instruction information input from the input unit 11 excludes the image data D ₅ to D ₇ from the image displayed.

Further, among the image data D _{1 to} D ₉ , the SCH mark is given to the image data D ₈ and D ₉ as described above. Therefore, the frame rate control unit 15c sequentially determines the display frame rates of the image data D ₈ and D ₉ to the normal setting display frame rate, and the image data D _{8 is} displayed on the display unit 12 at the normal setting display frame rate. performs control to sequentially image display the D _9.

By the operation of the frame rate control unit 15c, the display unit 12 displays each image of the subject 1 corresponding to the image data D _{1 to} D ₃ , D ₈ , D ₉ with a display time corresponding to the display frame rate set normally. Can be displayed sequentially. Further, the display unit 12 displays the image of the subject 1 corresponding to the first image data D ₄ in the continuous image group DG for the display time corresponding to the display frame rate set normally, and the remaining image data D _5. to D ₇ does not display the respective images of the subject 1 corresponding to (i.e., the image cut). In this case, the image data D ₄ is displayed on the display unit 12 as a representative image of the continuous image group DG, and the image data D _{5 to} D ₇ are excluded from display targets as images that repeat the same imaging scene as the image data D _4. Is done. Thus, the frame rate control unit 15c can reduce the display time of successive image group DG in comparison with the case of sequential image display the image data D ₄ to D ₇ in the display frame rate of the normal setting. Incidentally, the examiner, for example, if images or observed even representative image corresponding to the image data D _4, sufficient achieve the observed captured in successive image group DG object.

  As described above, in the first embodiment of the present invention, in a series of images, each correlation value between adjacent images of a plurality of pixel areas set on image data is calculated, and each of the plurality of pixel areas is calculated. A motion vector is calculated, and a continuous image group in which images having correlation values of the plurality of pixel regions equal to or greater than a predetermined threshold T1 are detected, that is, a continuous image group in which images having a high degree of similarity are continuous is detected. Based on each motion vector of the area, each image that repeats the same imaging scene in the continuous image group is specified, and one or more representative images are specified from the continuous image group. Further, one or more specified representative images in the continuous image group are displayed at, for example, a normal display frame rate, and the image is cut without displaying the remaining images that repeat the same imaging scene. Therefore, in a continuous image group in which images having a high degree of similarity among a series of images to be displayed are continuous, even if the subject is moving, one or more representative images specified from the continuous image group Realizes an image display device that can shorten the display time of images in the same imaging scene and shorten the observation time of a series of images in a subject that repeats periodic biological movements such as pulsation movements or peristaltic movements. can do.

(Modification of Embodiment 1)
Next, a modification of the first embodiment of the present invention will be described in detail. In the first embodiment described above, one or more representative images are specified from a group of continuous images in which images with high similarity are continuous, and images of the same imaging scene as the specified one or more representative images are excluded from display targets. In the modification of the first embodiment, the image of the same imaging scene is displayed at a display frame rate higher than that of one or more representative images without cutting the image. ing.

  FIG. 8 is a block diagram schematically showing a configuration example of an image display apparatus which is a modification of the first embodiment of the present invention. The image display device 17 includes a control unit 18 instead of the control unit 15 of the image display device 4 of the first embodiment. The control unit 18 is provided with a frame rate control unit 18c instead of the frame rate control unit 15c of the first embodiment. Other configurations are the same as those of the first embodiment, and the same reference numerals are given to the same components.

  The control unit 18 functions in substantially the same manner as the control unit 15 of the first embodiment described above, and selects one or more representative images from a continuous image group in which images having a high similarity are consecutive in a series of images to be displayed. The identified one or more representative images are displayed on the display unit 12 at the above-described normal setting display frame rate, and the remaining images other than the one or more representative images in the continuous image group, that is, one or more representative images. Are displayed on the display unit 12 at a display frame rate that is higher than the display frame rate of the normal setting. In this case, the frame rate control unit 18c adds the above-described SCH mark to the image data of the specified one or more representative images, and the image data of the same imaging scene as the one or more representative images in the group of continuous images. Instead of the above-described SK mark, a high-speed playback mark (hereinafter referred to as an HSP mark) is added. The HSP mark is a flag for specifying that the image is to be displayed at a display frame rate that is higher than the display frame rate set as described above.

  FIG. 9 is a flowchart for explaining another processing procedure for specifying one or more representative images from a continuous image group in which images having a high degree of similarity among a series of images are continuous. In the flowchart shown in FIG. 9 (steps S301 to S308), step S305 includes an HSP mark applying process for adding an HSP mark to image data instead of step S105 (SK mark applying process) in the flowchart shown in FIG. . Other processing procedures are the same as those in the flowchart (steps S101 to S108) shown in FIG.

That is, in FIG. 9, the control unit 18 performs the same processing as in steps S _< b _> 101 to S _< b _> 103 described above, and a plurality of pixel areas EA _n , EB _n , EC _n , ED on the image data D _{n in} a series of images. _It is determined whether or not each _n correlation value has a correlation value less than the threshold value T1 (steps S301 to S303). In this case, if the image detection unit 15b determines that the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n do not have a correlation value less than the threshold value T1 (No in step S303), the frame rate control The unit 18c determines whether the motion vectors VA _n , VB _n , VC _n , and VD _n on the image data D _n are aligned in the same direction as in step S104 described above (step S304).

When the frame rate control unit 18c determines in step S304 that the motion vectors VA _n , VB _n , VC _n , and VD _n are not aligned in the same direction (step S304, No), the image data D _n is described above. An HSP mark applying process for applying an HSP mark is performed (step S305). In this case, the control unit 18 stores the image data D _n to which the HSP mark is added in the storage unit 14.

On the other hand, the frame rate control unit 18c determines that the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _{n have} a correlation value less than the threshold T1 in step S303 ( step S303, Yes), performs the same SCH marking process to step S106 described above on the image data D _n (step S306). If the frame rate control unit 18c determines in step S304 that the motion vectors VA _n , VB _n , VC _n , VD _n are aligned in the same direction (step S304, Yes), the image data D _n On the other hand, the SCH mark giving process of step S306 is performed. In this case, the control unit 18 stores the image data D _n to which the SCH mark is added in the storage unit 14.

When the frame rate control unit 18c completes step S305 or step S306, the control unit 18 performs the same processing as step S107 described above (step S307), and the processing has not been completed for all the image data. If it is determined (No at Step S307), the next image data D _{n + 1} is read (Step S308), and then the processing procedure after Step S302 is repeated using this image data D _{n + 1} . On the other hand, if the control unit 18 determines that the processing has been completed for all the image data (step S307, Yes), the processing procedure after step S302 described above is terminated.

  The control unit 18 repeats the processing procedure after step S301 described above as necessary, so that the imaging time of an adjacent image group in which images of different imaging scenes are adjacent among a series of images in the subject 1 is determined. An SCH mark is given to the rear image data, and an HSP mark is given to the image data of the rear side of the adjacent image group where the images of the same imaging scene are adjacent. In this case, the control unit 18 can add the SCH mark to the image data of one or more representative images in the continuous image group in which images having a high degree of similarity are continuous. One or more representative images can be identified. FIG. 10 is a schematic diagram for explaining an operation of specifying one or more representative images by adding an HSP mark or an SCH mark to each image data of a series of image data.

As shown in FIG. 10, each image data D ₁ , D ₂ , D ₃ , D ₄ , D ₅ , D ₆ , D ₇ , D ₈ , D ₉ ,. be the same as the frame rate control unit 18c, respectively impart SCH mark to the image data _{D 1 ~D 3, D 8,} D 9. The frame rate control unit 18c among the successive image group DG to high image data D ₄ to D ₇ similarity continues, the SCH mark attached to the image data D _4, the image data D ₄ and the same image scene imparting HSP mark to the image data D ₅ to D _7.

Here, the frame rate control unit 18c, of the successive image group DG, by applying the HSP marks instead of SK marks described above to the image data D ₅ to D ₇ to repeat the same image scene and the image data D ₄ the image data D ₅ to D ₇ together is identified as the image data to be high-speed reproduction, for specifying the image data D ₄ as a representative image of the successive image group DG. In this case, the frame rate control unit 18c, as described above, to impart SCH mark to the image data D ₄ is the representative image. The frame rate control unit 18c adds an HSP mark to each image data that repeats an image of the same imaging scene in a series of images, so that a representative image is obtained for each successive image group in which images with high similarity are consecutive. Can be identified. At the same time, the frame rate control unit 18c does not depend on the movement of the subject between the adjacent images, for example, even when the subject repeats periodic biological movement in the continuous image group DG, Each image data that repeats images of the same imaging scene can be specified as image data to be reproduced at high speed.

Next, an operation in which the frame rate control unit 18c sequentially displays a series of image data in the subject 1 will be described in detail. FIG. 11 is a flowchart illustrating a processing procedure for sequentially displaying a series of image data to which the above-described SCH mark or HSP mark is added. 11, the frame rate control unit 18c, similar to step S201 described above, reads the image data D _n of a series of images inside the subject 1 from the storage unit 14 (step S401). Next, the frame rate control unit 18c is to the image data D _n, determines which of HSP marks and SCH mark described above is applied (step S402).

Frame rate control unit 18c in step S402, it is determined in this case detects a SCH mark from image data D _n, marks assigned to the image data D _n is SCH mark (step S402, SCH mark), the SCH mark to determine the normal display frame rate setting the display frame rate described above of the image data D _n granted (step S403).

On the other hand, the frame rate control unit 18c in step S402, the case where the image data D _n detects the HSP mark, it is determined that marks given to the image data D _n is HSP mark (step S402, HSP mark ), The display frame rate of the image data D _n to which the HSP mark is added is determined to be a display frame rate set at a high speed (step S404). The high-speed display frame rate is a display frame rate that is higher than the normal display frame rate corresponding to any of the above-described reproduction operation icon groups 100.

Frame rate control unit 18c, when completing the step S403 or S404 described above, to the display unit 12 performs control to display the image data D _n of SCH mark or HSP mark is assigned (step S405). In this case, the frame rate control unit 18c is to the display unit 12 performs control to display the display frame rate of the normal setting described above the image data D _n the SCH mark is assigned, the image data HSP mark is assigned Control is performed to display D _n at the display frame rate set at the high speed described above.

Thereafter, the frame rate control unit 18c performs the same processing as in step S206 described above (step S406), and if it is determined that all the images have not yet been reproduced on the display unit 12 (step S406, No), The image data D _{n + 1} is read (step S407), and then the above-described processing procedure from step S402 is repeated on the image data D _{n + 1} . On the other hand, if the frame rate control unit 18c determines that all the images have been reproduced on the display unit 12 (step S406, Yes), a processing procedure for sequentially displaying a series of image data in the subject 1 designated for display is performed. finish.

Here, using image data D ₁ to D ₉ of the subject 1 shown in FIG. 10 described above, the frame rate control unit 18c will be described a specific example of operation for sequentially displaying the series of images of the subject 1 . In step S401 to S407, the frame rate control unit 18c, for example sequentially reads image data D ₁ to D ₉ of the subject 1. Among these image data D _{1 to} D ₉ , the SCH mark is given to the image data D _{1 to} D ₃ as described above. Therefore, the frame rate control unit 18c sequentially determines the display frame rates of the image data D _{1 to} D ₃ as normal display frame rates corresponding to any of the above-described reproduction operation icon groups 100, and displays them on the display unit 12. On the other hand, control is performed to sequentially display the image data D _{1 to} D ₃ at the display frame rate set at the normal setting.

In addition, as described above, the SCH mark is given to the image data D ₄ in the continuous image group DG in which images with high similarity are continuous. Accordingly, the control frame rate control unit 18c determines the display frame rate of the image data D ₄ to the display frame rate of the normal setting, to the display unit 12, an image displaying the image data D ₄ in the display frame rate of the normal setting I do. On the other hand, in the continuous image group DG, the HSP mark is given to the image data D _{5 to} D ₇ as described above. Thus, the frame rate control unit 18c is to the display unit 12 performs control to sequentially image display the image data D ₅ to D ₇ in the display frame rate of the high speed setting.

Further, among the image data D _{1 to} D ₉ , the SCH mark is given to the image data D ₈ and D ₉ as described above. Therefore, the frame rate control unit 18c sequentially determines the display frame rates of the image data D ₈ and D ₉ to the normal setting display frame rate, and the image data D _{8 is} displayed on the display unit 12 at the normal setting display frame rate. performs control to sequentially image display the D _9.

The operation of the frame rate control unit 18c, the display unit 12, like the first embodiment described above, usually the images inside the subject 1 corresponding to the image data _{D 1 ~D 3, D 8,} D 9 It is possible to display sequentially with the display time corresponding to the set display frame rate. In addition, the display unit 12 displays an image in the subject 1 corresponding to the first image data D ₄ in the continuous image group DG at a normal display frame rate, and displays the remaining image data D _{5 to} D ₇ . sequentially displayed at a high display frame rate than the images of the corresponding subject 1 to the image data D _4. In this case, the image data D ₄ is displayed on the display unit 12 as a representative image of the continuous image group DG at a display time corresponding to the display frame rate set normally, and the image data D _{5 to} D ₇ are image data D _5. an image repeating ₄ the same image scene are sequentially image display by reducing the relative to the image data D ₄ display time per unit frame. Thus, the frame rate control unit 18c can shorten the display time of successive image group DG in comparison with the case of sequential image display the image data D ₄ to D ₇ in the display frame rate of the normal setting.

  As described above, the modified example of the first embodiment of the present invention has substantially the same function as that of the above-described first embodiment, and a series of consecutive images having a high degree of similarity among a series of images. One or more representative images identified from the image group are displayed at, for example, a normal display frame rate, and each image that repeats the same imaging scene as one or more representative images is displayed at a higher speed than one or more representative images. Displayed at frame rate. Therefore, it is possible to realize an image display apparatus that can enjoy the effects of the first embodiment described above and can observe the movement of the subject represented by the continuous image group with a pseudo moving image.

(Embodiment 2)
Next, a second embodiment of the present invention will be described in detail. In the first embodiment described above, it is determined whether or not the motion vectors on the image data are aligned in the same direction in a continuous image group in which images with high similarity among a series of images are continuous. In this embodiment, an image group that repeats the same imaging scene in the continuous image group is specified and other than the image group that repeats the same imaging scene is specified as one or more representative images. In 2, the image group representing the reciprocating motion of a plurality of pixel areas set on the image data is specified as one or more representative images among the continuous image group.

  FIG. 12 is a block diagram schematically showing a configuration example of an image display apparatus according to the second embodiment of the present invention. The image display device 21 is provided with a control unit 22 instead of the control unit 15 of the image display device 4 of the first embodiment. The control unit 22 is provided with an arithmetic processing unit 22a instead of the arithmetic processing unit 15a of the first embodiment, and an image detection unit 22b is provided instead of the image detecting unit 15b of the first embodiment. A frame rate control unit 22c is provided instead of the frame rate control unit 15c. Other configurations are the same as those of the first embodiment, and the same reference numerals are given to the same components.

The control unit 22 functions in substantially the same manner as the control unit 15 described above. As described above, the control unit 22 includes the arithmetic processing unit 22a, the image detection unit 22b, and the frame rate control unit 22c, and a FIFO type memory (see FIG. (Not shown). The arithmetic processing unit 22a has the same function as the arithmetic processing unit 15a described above, and calculates, for example, each correlation value of a plurality of pixel areas EA _n , EB _n , EC _n , ED _n set on the image data D _n. Then, each motion vector VA _n , VB _n , VC _n , VD _n is calculated. In addition, the arithmetic processing unit 22a, when the motion vectors VA _n , VB _n , VC _n , VD _n are motion vectors having a magnitude greater than or _equal to a predetermined threshold value P, respectively, includes a plurality of pixel areas EA _n , EB _n , EC _n. , ED _n , a vector addition process is performed in which motion vectors VA _n , VB _n , VC _n , VD _n having a magnitude greater than or _{equal to} the threshold P are added for each direction to calculate each vector addition value. This vector addition value is a vector component of each motion vector calculated for each direction by this vector addition process.

The image detection unit 22b uses the threshold value T2 instead of the threshold value T1 described above, and determines whether each of the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _{n has} a correlation value less than the threshold value T2. to decide. Further, the image detecting unit 22b, based on the result of judgment on the correlation value, and detects the image data D _n of the image data D _n or identical imaging scene immediately before the image data D _n-1 and different imaging scenes. Thus, the image detecting unit 22b, the image data D _n of the immediately previous image data D _n-1 different from the image scene successive image group or previous image data D _n-1 and the same image scene of the image data D _n is continuous in Detects a continuous image group.

  The frame rate control unit 22c has substantially the same function as the above-described frame rate control unit 15c. Further, the frame rate control unit 22c, based on each vector addition value calculated by the vector addition process of the arithmetic processing unit 22a, from the continuous image group in which the image data of the same imaging scene is continuous, the above-described periodic image. A representative image group representing a repetitive motion of a subject such as a simple biological motion as a pseudo moving image is specified.

  FIG. 13 is a flowchart illustrating a processing procedure for specifying a representative image group representing a repetitive operation of a subject from a continuous image group in which images of the same imaging scene in a series of images are continuous. The control unit 22 determines whether the imaging scene of each image data of a series of images in the subject 1 captured by the capsule endoscope 2 has changed between adjacent images, and the control unit 15 described above. Similarly, an SCH mark is added to the image data when it is determined that the imaging scene has changed between the adjacent images, and an SK mark is added to the image data when it is determined that the imaging scene is the same between the adjacent images. . Further, the control unit 22 performs SK mark erasure processing for erasing each SK mark of the image group corresponding to one cycle of the repetitive operation of the subject, for example, among the continuous image group to which the SK mark is given, and this repeated image group. Is identified as a representative image group to be observed.

That is, in FIG. 13, the control unit 22 reads the image data D _n of the series of image data, for example, the first image data D ₁ in the same manner as in step S101 described above (step S501), and the FIFO memory of the control unit 22 Each vector addition value stored in (1) is reset (step S502). After that, the arithmetic processing unit 22a calculates the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , ED _n on the image data D _n and performs the motion vectors VA _n as in step S102 described above. , VB _n, VC _n, calculates the VD _n (step S503).

Next, the control unit 22, the image scene of the image data D _n is equal to or the same as the image data D _n-1 of the immediately preceding. In this case, the image detection unit 22b compares the threshold value T2 set in advance instead of the threshold value T1 described above with the correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n , and is less than the threshold value T2. It is determined whether there is a correlation value (step S504). Here, if the adjacent image data D _n-1 and D _n are in the same shooting scene, the image data D _n has a high degree of similarity to the immediately preceding image data D _n-1 . The correlation values of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n are all image data having a threshold value T2 or more. Therefore, when the image detection unit 22b determines in step S504 that the correlation values of the pixel areas EA _n , EB _n , EC _n , and ED _n do not have a correlation value less than the threshold T2 (step S504, No), the control unit 22 Determines that the image data D _n-1 and D _{n belong} to the same imaging scene. In this case, the image detection unit 22b detects the image data D _n−1 and D _n of the same captured scene as a continuous image group in which images having correlation values of a plurality of pixel areas equal to or greater than the threshold T2 are continuous.

When the image data D _n−1 and D _n are of the same shooting scene, the control unit 22 gives the above-described SK mark to the image data D _n . In this case, the frame rate control unit 22c performs SK marking treatment for imparting SK mark to the image data D _n of the image data D _n-1 and the same image scene (step S505).

If the frame rate control unit 22c has granted the SK mark to the image data D _n, the control unit 22, the motion vector VA _n image data D _n having the SK marks, VB _n, VC _n, the VD _n size Is greater than or equal to a predetermined threshold value P (step S506). When the control unit 22 determines that the motion vectors VA _n , VB _n , VC _n , and VD _n are greater than or _equal to the threshold P (step S506, greater than or equal to the threshold P), the control unit 22 determines a motion vector greater than or _equal to the threshold P. The above-described vector addition process is performed only for the pixel regions that have (step S507). In this case, the arithmetic processing unit 22a adds motion vectors having a magnitude greater than or _{equal to} the threshold value P for each of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n in each direction, thereby obtaining the pixel areas EA _n , EB _n , Vector addition values for each of EC _n and ED _n are calculated. In addition, the arithmetic processing unit 22a excludes motion vectors having a size less than the threshold value P from the motion vectors VA _n , VB _n , VC _n , and VD _n from the addition targets of the vector addition processing. That is, the arithmetic processing unit 22a does not add a motion vector having a magnitude less than the threshold value P in the vector addition process described above. The control unit 22 sequentially stores the vector addition value for each pixel area EA _n , EB _n , EC _n , ED _n calculated by the arithmetic processing unit 22a in each memory area of the FIFO type memory, and then proceeds to step S511. . If the control unit 22 determines in step S506 that the motion vectors VA _n , VB _n , VC _n , and VD _n are less than the threshold value P (step S506, less than the threshold value P), the above-described step It progresses to step S511, without performing S507.

On the other hand, when the image detection unit 22b determines in step S504 that the correlation values of the pixel areas EA _n , EB _n , EC _n , and ED _{n have} a correlation value less than the threshold T2 (step S504, Yes), the control unit 22 Determines that the image data D _n-1 and D _n belong to different imaging scenes. In this case, the image detecting unit 22b, a plurality of correlation values is the threshold value T2 below i.e. low similarity image of the pixel region, detects the image data D _n of the immediately previous image data D _n-1 and different imaging scenes To do.

When the image data D _n−1 and D _n are in different shooting scenes, the control unit 22 gives the above-described SCH mark to the image data D _n . In this case, the frame rate control unit 22c performs SCH marking treatment for imparting SCH mark to the image data D _n with a different image scene image data D _n-1 (step S508).

  Next, the control unit 22 performs the above-described periodic biological motion in the continuous image group that is continuous between the image data to which the SCH mark is added in step S508 and the image data to which the SCH mark has been previously added. It is determined whether or not there is a repeated image group that represents the repeated operation of the subject such as a pseudo moving image. Note that the continuous image group is an image group in which image data of the same imaging scene to which the SK mark is added in step S505 described above is continuous. In this case, the frame rate control unit 22c reads out, from the FIFO type memory of the control unit 22, the vector addition value for each of the plurality of pixel regions obtained by the vector addition process described above for each image data of the continuous image group. Then, the frame rate control unit 22c performs a repetitive operation of the subject such as a periodic biological motion represented by a pseudo moving image by the continuous image group based on the read vector addition value for each of the plurality of pixel regions. It is determined whether or not there is (step S509).

  Specifically, when the frame rate control unit 22c detects that at least one of a plurality of pixel regions of each image data in the continuous image group repeats reciprocating movement for two or more cycles, the subject in the continuous image group Is detected (step S509, Yes). In this case, the control unit 22 determines that the above-described repeated image group is included in the continuous image group, and the frame rate control unit 22c includes, for example, a desired number of repetition image groups included in the continuous image group. An SK mark erasure process for erasing the SK mark of each image data of the image group corresponding to the repetition operation of the subject in one cycle is performed (step S510). The frame rate control unit 22c specifies each image data in which the SK mark is erased from the repeated image group as the image data to be observed, and sets the image group in which the image data from which the SK mark is erased continues for the desired number of times. Can be specified as a representative image group that represents a repetitive motion of the subject with a pseudo moving image. The control unit 22 saves each image data of the identified representative image group in the storage unit 14, and then proceeds to step S511.

  On the other hand, the frame rate control unit 22c does not detect the repetitive motion of the subject in the continuous image group unless it detects that the reciprocating movement is repeated two or more periods in the plurality of pixel regions of each image data in the continuous image group. (Step S509, No). The SK mark erasure process in step S510 described above is not performed. In this case, the frame rate control unit 22c sets this continuous image group as an image cut target as an image group in which the same imaging scene is repeated. Accordingly, the frame rate control unit 22c can specify, for example, a continuous image group in which the subject is almost stationary as an image cut target. Thereafter, the control unit 22 proceeds to step S511.

As described above, when step S506 or S507 is completed, or when step S509 or S510 is completed, the control unit 22 performs the same process as step S107 described above (step S511), and still performs the processing on all image data. If it is determined that the processing has not been completed (step S511, No), the next image data D _{n + 1} is read (step S512), and then the above-described step S503 and subsequent steps are performed using this image data D _{n + 1} . Repeat the procedure. On the other hand, when the control unit 22 determines that the processing is complete for all image data (step S511, Yes), the processing procedure after step S503 described above is terminated.

Next, the vector addition process in step S507 described above will be described in detail. FIG. 14 is a schematic diagram illustrating an operation in which the arithmetic processing unit 22a performs a vector addition process. FIG. 15 is a schematic diagram for explaining the operation of storing the vector addition value obtained by the vector addition process in each memory area of the FIFO memory. In FIG 14 and 15, a plurality of pixel regions _{EA n, EB n, EC n} , a specific example for the pixel region EB _n of ED _n.

As shown in FIG. 14, the arithmetic processing unit 22a repeats the motion vector calculation processing in step S503 described above, for example motion by calculating a correlation value of the pixel area EB ₁ ~EB ₁₃ of the image data D ₁ to D ₁₃ The vectors VB _{2 to} VB ₁₃ are calculated. Here, among the motion vectors VB ₂ through Vb _13, the motion vector VB ₂ ~VB _4, VB ₁₂ is a vector with a threshold value P or more magnitude and direction F1, the motion vector VB _5, VB _9, VB ₁₃ Is a vector having a magnitude greater than or equal to the threshold P and a direction F2. Also, the motion vectors VB _{6 to} VB ₈ , VB ₁₀ , VB ₁₁ are vectors having a magnitude less than the threshold value P. In this case, the arithmetic processing unit 22a repeatedly performs the vector addition process in step S507 described above, and calculates a vector addition value SVB ₁ obtained by sequentially adding the motion vectors VB _{2 to} VB ₄ in the direction F1. As shown in FIG. 15, the control unit 22 stores the calculated vector addition value SVB ₁ in the memory area M1.

On the other hand, since the motion vector VB ₅ has a direction F2 different from that of the motion vector VB ₄ added by the previous vector addition process, the arithmetic processing unit 22a sequentially adds the motion vectors VB _{2 to} VB ₄ to the vector addition value SVB _1. with determined is the summation adds the motion vector VB ₅ as a vector addition value SVB ₂ vector addition value SVB ₁ different direction F2. In this case, the control unit 22 stores the motion vector VB ₅ as the vector addition value SVB ₂ in the memory area M2. Further, the arithmetic processing unit 22a sequentially excludes the motion vectors VB _{6 to} VB ₈ having a size less than the threshold value P from the vector addition processing target, and uses the motion vector VB ₉ in the direction F2 as the vector addition value SVB ₂ as the motion vector VB _5. Add to. In this case, the control unit 22 updates the vector addition value SVB ₂ memory areas M2 motion that sequentially adding the vector VB _5, VB _9.

Next, the arithmetic processing unit 22a sequentially excludes the motion vectors VB ₁₀ and VB ₁₁ having a magnitude less than the threshold value P from the vector addition processing targets. Here, the motion vector VB ₁₂ has a direction F1 different from the motion vector VB ₉ added by the previous vector addition process. Therefore, the arithmetic processing unit 22a is configured to determine that in which the vector sum value SVB ₂ by sequentially adding the vector VB _5, VB ₉ motion, the motion as a vector addition value SVB ₃ directions F1 different from the vector addition value SVB ₂ adding the vector VB _12. In this case, the control unit 22 stores the motion vector VB ₁₂ as the vector addition value SVB ₃ in the memory area M3.

The motion vector VB ₁₃ has a direction F2 different from the motion vector VB ₁₂ added by the previous vector addition process. Therefore, the arithmetic processing unit 22a is configured to determine that the vector VB ₁₂ motion vector addition value SVB _3, adds the motion vector VB ₁₃ as a vector addition value SVB ₄ direction F2 different from the vector addition value SVB _3. In this case, the control unit 22 stores the motion vector VB ₁₃ as the vector addition value SVB ₄ in the memory area M4. Then, the arithmetic processing unit 22a if calculating the movement vector VB ₁₄ different from the direction F2 for the pixel region EB ₁₄ of the next image data D _14, or captured image data D ₁₄ of the next is different from the image data D ₁₃ scenes If is of, the processing unit 22a will determine that the vector VB ₁₃ motion vector addition value SVB _4. Note that the arithmetic processing unit 22a calculates, for example, an angle between the horizontal direction and the motion vector as to whether or not the motion vectors have the same direction, and if the difference between the angles of the motion vectors is equal to or less than a threshold value. Suppose they are in the same direction.

Thus, the processing unit 22a, for example the pixel area EB _n on the image data D _n, sequentially adds the motion vector VB _n threshold P size or larger by direction, the direction of the motion vector of the vector addition processing target Each time changes, the vector addition value is determined. For example, for the pixel region EB _n , the control unit 22 sequentially stores the calculated vector addition value by changing the memory region for each direction. Incidentally, the arithmetic processing unit 22a, in addition to the pixel area EA _n on the image data D _n, EC _n, the ED _n, as in the case of the pixel region EB _n described above, it calculates the vector sum value for each direction. As in the case of the pixel area EB _n described above, the control unit 22 sequentially stores the obtained vector addition values for the other pixel areas EA _n , EC _n , and ED _n by changing the memory area for each direction. In this case, the FIFO memory of the control unit 22 has at least four memory areas for each of the plurality of pixel areas EA _n , EB _n , EC _n , and ED _n .

Next, the operation of the frame rate control unit 22c for specifying the above-described representative image group from the continuous image group in which the images of the same imaging scene in the series of images are continuous will be specifically described. FIG. 16 is a schematic diagram for explaining the operation of specifying the representative image group described above from the continuous image group. Note that the image data of the first image data D _1, the image data D ₁ and the image data D ₂ to D ₁₃ of the same image scene, a different imaging scene image data D ₁ to D ₁₃ of FIG. 16, a series of images D ₁₄ is illustrated.

16, the frame rate control unit 22c, as described above, the SCH mark is given to the first image data D ₁ of the, the SK mark to the image data D ₂ to D ₁₃ of the same image scene and the image data D ₁ Grant sequentially. The frame rate control unit 22c assigns a SCH mark to the image data D ₁₄ of the image data D ₁ to D ₁₃ with different image scene. Here, the frame rate control unit 22c in step S509 described above, the subject of the periodic biological motion or the like to the image data D ₁ to D ₁₃ consecutive between the image data D _1, D ₁₄ imparted with SCH mark It is determined whether or not there is a repeated operation.

In this case, the frame rate control unit 22c reads out the vector sum of a plurality of pixels each area of the image data D ₁ to D ₁₃ stored in the FIFO memory of the control unit 22 as illustrated in FIG. 15. Frame rate control unit 22c based on each vector addition value read, when detecting that repeats reciprocating at least one of the plurality of pixel areas of the image data D ₁ to D ₁₃ 2 or more cycles, the image data detecting the repetitive operation of the subject in D ₁ to D _13.

For example, in the vector addition value illustrated in FIG. 15, the frame rate control unit 22c has a difference between the magnitudes of the vector addition values SVB ₁ and SVB ₂ equal to or less than a predetermined value, and the magnitudes of the vector addition values SVB ₂ and SVB ₃ . When the difference in height is less than or equal to a predetermined value and the difference in magnitude between the vector addition values SVB ₃ and SVB ₄ is less than or equal to a predetermined value, the direction F1 (outward direction) and the direction F2 in the vector addition values SVB _{1 to} SVB ₄ A pixel region EB _n that repeats the reciprocating movement in the (return direction) two cycles is detected. Note that the frame rate control unit 22c has the sum of the vector components of the vector addition values SVB ₁ and SVB ₂ equal to or less than a predetermined value, and the sum of the vector components of the vector addition values SVB ₂ and SVB ₃ is equal to or less than the predetermined value. When the sum of the vector components of the vector addition values SVB ₃ and SVB ₄ is not more than a predetermined value, the vector addition values SVB _{1 to} SVB ₄ are reciprocated in the direction F1 (forward direction) and the direction F2 (return direction). May be detected for a pixel region EB _n that repeats two cycles.

Frame rate control unit 22c, the other pixel region EA _n of the image data D ₁ ~D _13, EC _n, performs the same processing as that of the pixel region EB _n also ED _n, the image data D ₁ to D ₁₃ When detecting at least one of the plurality of pixel areas EA _n , EB _n , EC _n , ED _n that repeats reciprocating movements for two or more periods, the repetition operation of the subject in the image data D _{1 to} D ₁₃ is detected. In this case, the continuous image group based on the image data D _{1 to} D ₁₃ is an image group that represents a repetitive operation of the subject such as a periodic biological motion as a pseudo moving image.

Frame rate control unit 22c, for example when detecting a repeated operation of the object in the image data D ₁ to D _13, performs the step S510 described above, the image data D ₁ to D of predetermined number of times for example one period of the ₁₃ The SK mark of the image data representing the repeated operation of the subject is deleted. In this case, the frame rate control unit 22c, among the image data _{D 2 ~D 5, D 9,} D 12, D 13 having a motion vector included for example in the vector addition value SVD ₁ ~SVD ₄ illustrated in FIG. 15, The SK mark is erased from the image data representing the repeated operation of the subject for one time. For example, the frame rate control unit 22c displays the SK marks of the image data D _{2 to} D ₅ and D ₉ having the motion vectors included in the direction F1, that is, the vector addition value SVD _{1 in the} forward direction and the direction F2, that is, SVD ₂ in the backward direction. to erase. Thus, the frame rate control unit 22c, from among the successive image group by the image data D ₁ to D _13, the image data D ₁ to D _5, the representative image group that represents the D ₉ repeating operation of the object in a pseudo moving Can be specified as

The frame rate control unit 22c in step S510, for example, the image data D ₁ to D _5, the image data D ₆ ~ magnitude of each motion vector of the successive image group DG1 containing D ₉ is less than the threshold P and SK mark D _8, not erased and SK mark of the respective image data D ₁₀ to D ₁₃ of the successive image group DG2 other than successive image group DG1 of the image data D ₁ to D _13. Thus, the frame rate control unit 22c can identify the representative image group of the image data D ₁ to D ₁₃ to other (that is, the image data D ₁ ~D _5, D ₉₎ as an image cut target.

Next, an operation in which the frame rate control unit 22c sequentially displays a series of image data in the subject 1 will be described. FIG. 17 is a flowchart illustrating a processing procedure for sequentially displaying image data to which the SCH mark is added or image data from which the SK mark is deleted from a series of image data. In FIG. 17, the frame rate control unit 22c reads the image data D _n of the series of images in the subject 1 from the storage unit 14 as in step S201 described above (step S601), and this image data D _n. It is determined whether or not the above-described SCH mark is given (step S602).

Frame rate control unit 22c in step S602, unless detect SCH mark from image data D _n (step S602, No), SCH mark is determined not to be assigned to the image data D _n, the above-described step Similar to S203, the display frame rate of the image data is determined to be the above-described normal display frame rate (step S603).

On the other hand, the frame rate control unit 22c in step S602, when detecting SCH mark from image data D _n (step S602, Yes), determines that the SCH mark is applied to the image data D _n, step S603 The display frame rate set to the low speed is determined as compared with the display frame rate set to the normal setting (step S604). Note that the display frame rate set at the low speed is a display frame rate that is lower than the display frame rate set at the normal setting corresponding to any of the above-described reproduction operation icon groups 100.

Next, the frame rate control unit 22c determines whether or not the above-described SK mark is added to the image data D _n subjected to the processing of step S603 or S604 (step S605). In this case, the frame rate control unit 22c determines that the if the image data D _n not detect the SK mark (step S605, No), SK mark is not added to the image data D _n, the display unit 12 On the other hand, control is performed to display the image data D _n not provided with the SK mark (step S607). Specifically, if the image data D _n to which the SK mark is not attached is the image data determined as the normal display frame rate in step S603, the frame rate control unit 22c Control is performed to display the image data D _n at a display frame rate set at a normal setting. Further, if the image data D _n not provided with the SK mark is the image data determined as the display frame rate set at the low speed in step S604, the frame rate control unit 22c sends the image data D to the display unit 12. Performs control to display _n at the display frame rate set to low speed.

On the other hand, the frame rate control unit 22c, when detecting the SK mark from image data D _n at step S605 (step S605, Yes), excluding the image data D _n of the SK mark is assigned from the image display (step S606), the SK mark is (that is, the image cut not displayed on the display section 12 the image data D _n granted).

When the processing in step S605 or S606 is completed, the frame rate control unit 22c performs the same processing as in step S206 described above (step S608), and determines that all the images have not yet been reproduced on the display unit 12. (Step S608, No), the next image data D _{n + 1} is read out (Step S609), and then the processing procedure after Step S602 described above is repeated for this image data D _{n + 1} . On the other hand, if the frame rate control unit 22c determines that all the images have been reproduced on the display unit 12 (step S608, Yes), a processing procedure for sequentially displaying a series of image data in the subject 1 designated for display is performed. finish.

Here, using image data D ₁ to D ₁₄ of the subject 1 shown in FIG. 16 described above, the frame rate control unit 22c will be described a specific example of operation for sequentially displaying the series of images of the subject 1 . In step S601～S609, the frame rate control unit 22c, for example, sequentially reads image data D ₁ to D ₁₄ in the subject 1. Frame rate control unit 22c determines a first display frame rate of the image data D ₁ of the the SCH mark is assigned to the display frame rate of the low-speed setting, to the display unit 12, the image data D ₁ at a slower display frame rate Control to display the image.

Next, the frame rate control unit 22c determines the display frame rate of the image data D ₂ to D ₅ of SK mark and SCH mark is not both granted to the display frame rate of the normal setting, to the display unit 12, an image Control is performed to sequentially display the images of the data D _{2 to} D ₅ at the normal display frame rate. Thereafter, the frame rate control unit 22c does not sequentially excluding the image displayed on the display section 12 the image data D ₆ to D ₈ of SK mark is assigned from the image displayed, SK marks and SCH marks are both granted The display frame rate of the image data D _{9 that} is not present is determined as the normal setting display frame rate, and the display unit 12 is controlled to display the image data D ₉ as a normal setting display frame rate image.

Thereafter, the frame rate control unit 22c does not sequentially excluding the image displayed on the display section 12 the image data D ₁₀ to D ₁₃ that SK mark is assigned from the image displayed, the image data SCH mark is assigned D ₁₄ the display frame rate determined at the display frame rate of the low-speed setting, to the display unit 12 performs control to image display of the image data D ₁₄ on the display frame rate of the low speed setting.

The operation of the frame rate control unit 22c, the display unit 12, for example, displayed on a display time corresponding images inside the subject 1 corresponding to the image data D ₁ SCH mark is assigned to the display frame rate of the low speed setting Next, each image in the subject 1 corresponding to the image data D _{2 to} D ₅ , D ₉ to which neither the SCH mark nor the SK mark is assigned, that is, the representative image group, corresponds to the normal display frame rate. sequentially displayed in display, then the display in display the image inside the subject 1 SCH mark corresponding to the image data D ₁₄ granted corresponding to the display frame rate of the low speed setting. In this case, the display unit 12 displays the image data D ₁ and D ₁₄ by extending the display time for each unit frame as compared with the image data D _{2 to} D ₅ and D ₉ .

Further, the display unit 12 does not display each image in the subject 1 corresponding to the image data D _{6 to} D ₈ and D _{10 to} D ₁₃ to which the SK mark is given (cuts the image). That is, the display unit 12, among the image data D ₂ to D ₁₃ of the image data D ₁ and the same image scene, a representative image representing one cycle of the repetitive operation of the subject, such as periodic constant biological motion pseudo videos The image data D _{2 to} D ₅ and D ₉ are sequentially displayed as a group at a display time corresponding to the normal display frame rate, and the image data D _{6 to} D ₈ , D ₁₀ , D ₁₁ and the representative image with the subject almost stationary are displayed. The image data D ₁₂ and D _{13 in} which the repetition operation of the subject represented by the group is repeated are not displayed. Thus, the frame rate control unit 22c, as well as the repetitive operation of an object, such as a periodic constant biological motion can be displayed on the display unit 12 in a pseudo moving image, for example, can reduce the display time of the image data D ₂ to D _13, The image data D _{2 to} D ₁₃ can be sequentially displayed in a shorter display time than when the image data D _{2 to} D ₁₃ are sequentially displayed at the normal display frame rate.

  As described above, in the second embodiment of the present invention, in addition to the function of the first embodiment described above, a subject is repeatedly operated on a continuous image group in which images of the same imaging scene in a series of images are continuous. If there is an image group to be represented, an image group representing the desired number of repetitions of the subject among the continuous image group is identified as a representative image group, and the identified representative image group is displayed based on, for example, a normal display frame rate. The images are sequentially displayed in time, and the display time of the remaining images other than the representative image group is shorter than that of the representative image group. Therefore, an image display device that can enjoy the effects of the first embodiment described above and can observe the repetitive motion of the subject such as the periodic biological motion represented by the continuous image group with a pseudo moving image is realized. it can.

  In the first and second embodiments of the present invention, when a series of image data stored in the portable recording medium 5 is captured, the SCH mark or the SK mark is added to the series of image data. The present invention is not limited to this, and a process of adding an SCH mark or an SK mark to a series of image data stored in the storage unit 14 may be performed. In addition, when sequentially displaying a series of image data, a process of adding an SCH mark or an SK mark to the series of image data may be performed in substantially real time. That is, when a series of image data stored in the storage unit 14 is sequentially displayed, image data of a desired number of frames before image display, for example, about 5 frames is sequentially preceded among the series of image data to be displayed. Then, the processing may be performed in which the SCH mark or the SK mark is added to the read image data of the desired number of frames.

  Further, in the first embodiment of the present invention and the modification thereof, the first image in the continuous image group in which images having a high degree of similarity are continuous is displayed as the representative image. However, the present invention is not limited to this. Instead of this, an image in a predetermined frame order in the group of continuous images may be displayed as a representative image. In addition, the representative image is not limited to one frame image, and one or more frames included in the continuous image group may be displayed as the representative image.

  Further, in the first and second embodiments of the present invention and the modification of the first embodiment, four pixel regions are set on each image data. However, the present invention is not limited to this, and each Two or more pixel regions may be set on the image data. In this case, it is desirable that the plurality of pixel regions on each image data be set at positions that are symmetric with respect to the frame center, and further, be positioned in the cross direction or the diagonal direction of the frame with respect to the frame center. It is desirable to set so as to. For example, it is desirable that the eight pixel regions are set symmetrically with respect to the frame center, and set at respective positions that are symmetrical with respect to the frame center in the cross direction or the diagonal direction.

  Further, in Embodiment 2 of the present invention, the representative image group specified from the continuous image group in which images of the same imaging scene are continuous includes the head image of the continuous image group. The image group representing the repetitive motion of the subject in the continuous image group may be specified as the representative image group, and the first image of the continuous image group may not be included in the representative image group. Good.

  Furthermore, in Embodiment 2 of the present invention, an image group that represents a subject's repetitive motion for one time out of a continuous image group in which images of the same imaging scene are continuous is specified as a representative image group. However, the present invention is not limited to this, and an image group that repeatedly represents the repetitive operation of a subject of two or more periods in the continuous image group may be specified as the representative image group.

  Further, in Embodiment 2 of the present invention, when a pixel region that performs two cycles of reciprocal movement is detected in a continuous image group in which images of the same imaging scene are continuous, an image group that represents a repetitive operation of a subject in this continuous image group However, the present invention is not limited to this, and when a pixel region that reciprocates for two cycles or more in this continuous image group is detected, the subject is repeatedly operated in this continuous image group. It may be determined that there is an image group representing.

  Furthermore, in Embodiment 2 of the present invention, the remaining images other than the representative image group in the continuous image group in which the images of the same imaging scene are continuous are excluded from the display target. However, the present invention is not limited to this. Instead, the display frame rate of the representative image group may be set to a higher display frame rate, and the remaining images other than the representative image group may be sequentially displayed. In this case, the remaining images other than the representative image group are displayed with a shorter display time for each unit frame than the representative image group.

  In the second embodiment of the present invention, the FIFO type memory is used as the storage means for storing the vector addition value. However, the present invention is not limited to this, and a pixel area is used instead of the FIFO type memory. Various memories each having at least four memory areas may be used. In this case, the vector addition value in each memory area may be reset each time when the repetitive motion of the subject is not detected in step S509 described above and when the SK mark erasing process in step S510 described above is completed. .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic view schematically illustrating a configuration example of a capsule endoscope system using an image display apparatus according to Embodiment 1 of the present invention. It is a block diagram which shows typically the example of 1 structure of the image display apparatus which is Embodiment 1 of this invention. It is a flowchart explaining the process sequence for specifying one or more representative images from a continuous image group in which images having a high degree of similarity are continuous. It is a schematic diagram explaining the operation | movement of a motion vector calculation process. It is a schematic diagram for demonstrating the operation | movement which provides a SK mark or a SCH mark, and specifies one or more representative images. It is a schematic diagram which illustrates concretely the display screen of a display part. It is a flowchart explaining the process sequence for displaying a series of image data which provided the SCH mark or the SK mark sequentially. It is a block diagram which shows typically one structural example of the image display apparatus which is a modification of Embodiment 1 of this invention. It is a flowchart explaining another process sequence for specifying one or more representative images from a continuous image group. It is a schematic diagram for demonstrating the operation | movement which assign | provides an HSP mark or an SCH mark, and specifies one or more representative images. It is a flowchart explaining the process sequence for displaying a series of image data which provided the SCH mark or the HSP mark sequentially. It is a block diagram which shows typically the example of 1 structure of the image display apparatus which is Embodiment 2 of this invention. It is a flowchart explaining the process sequence for specifying a representative image group out of a continuous image group. It is a schematic diagram explaining the operation | movement of a vector addition process. It is a schematic diagram explaining the operation | movement which preserve | saves a vector addition value in each memory area of a FIFO type memory. It is a schematic diagram explaining the operation | movement which specifies a representative image group out of a continuous image group. It is a flowchart explaining the process sequence for displaying sequentially the image data which gave the SCH mark, or the image data which deleted the SK mark.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Subject 2 Capsule endoscope 3 Receiving device 3a-3h Reception antenna 4, 17, 21 Image display device 5 Portable recording medium 11 Input part 12 Display part 13 Reader / writer 14 Storage part 15, 18, 22 Control part 15a , 22a arithmetic processing section 15b, 22b image detecting unit 15c, 18c, 22c frame rate control unit 100 play operation icon group D _n image data DG, DG1, DG2 successive image group _{EA n, EB n, EC n} , ED n pixel region SVB ₁ , SVB ₂ , SVB ₃ , SVB ₄ vector addition values VA _n , VB _n , VC _n , VD _n motion vectors

Claims (8)

In an image display device that displays a series of images taken along a time series,
Calculating means for calculating a correlation value of a plurality of pixel areas set on each image of the series of images, and calculating a motion vector of the plurality of pixel areas;
Image detecting means for detecting a continuous image group in which images in which correlation values of the plurality of pixel regions between adjacent images are a predetermined value or more are continuous;
Frame rate control means for performing control to specify one or more representative images from the continuous image group and to display the one or more representative images at a display frame rate different from that of the remaining images other than the one or more representative images. ,
An image display device comprising:   The image display apparatus according to claim 1, wherein the frame rate control unit excludes the remaining images.   The image display apparatus according to claim 1, wherein the frame rate control unit performs control to display the remaining image at a display frame rate faster than the one or more representative images. The calculation means calculates a vector addition value obtained by adding the motion vector for each direction for each of the plurality of pixel regions,
The frame rate control means specifies an image group representing a reciprocating motion of each pixel area as the one or more representative images based on the vector addition value. The image display apparatus as described in any one.   The image display device according to claim 1, wherein the frame rate control unit excludes an image in which a motion vector of each pixel region is less than a predetermined size.   The frame rate control means performs control to display an image having a motion vector of each pixel area less than a predetermined size at a display frame rate faster than the one or more representative images. The image display apparatus as described in any one of Claims 1-4.   The image display device according to claim 1, wherein the one or more representative images include at least a head image of the continuous image group.   The image display according to claim 1, wherein the one or more representative images represent a part of a motion or a peristaltic motion of a subject imaged in the continuous image group. apparatus.

Images