JP2010272037A - Image processing apparatus and photographing system - Google Patents

Abstract

An image is displayed in an easy-to-see manner and operability is improved.
The display unit displays an observation image with a sample to be observed as a subject. In addition, a touch panel 42 that detects contact of the user with the display screen is superimposed on the display screen of the display unit 41. In the camera control device, each of the upper left area 71 to the lower right area 74 near the edge of the display screen is set as an effective area in which an input operation by the user's contact is valid, and the other areas are touched by the user. Even so, it is set as an invalid area in which the input operation by the contact is invalidated. When the camera control device detects the user's contact with the effective area in a state where only the observation image is displayed on the display screen, the camera control apparatus displays a predetermined menu for the area. The present invention can be applied to an image display device.
[Selection] Figure 3

Description

  The present invention relates to an image processing apparatus and a photographing system, and more particularly to an image processing apparatus and a photographing system that can display an image in an easy-to-see manner and improve operability.

  For example, when observing an observation target with a microscope, the observation image captured with the microscope is displayed on the image display device connected to the microscope, and the observation image is stored or processed. There are cases where it is desired to execute various processes while displaying an image.

  In such a case, if an image display device provided with a touch panel is used, the user simply instructs to execute the process simply by operating a button displayed on the display screen for executing various processes. be able to. In general, an image display device provided with a touch panel displays graphical switch buttons such as icons, and various functions can be realized by operating these buttons.

  In such an image display device, a button is displayed in a predetermined area, and a user touches an arbitrary position in a predetermined area wider than the button on the display screen. Sometimes, processing is performed on the assumption that a button is operated (see, for example, Patent Document 1). Some image display devices display buttons and menus when a user touches an arbitrary position on the display screen in a state where an observation image is displayed on the display screen.

JP-A-1-131919

  However, in the image display device that displays the buttons in advance, the display area of the observation image on the display screen becomes narrow due to the display of the buttons, and the user cannot easily display the observation image and the buttons.

  In addition, in an image display device that displays buttons and menus when contact with the display screen is detected, when the user does not intend, such as when the user touches the display screen to indicate a position on the observation image The buttons were displayed, which was inconvenient. In such an image display device, in order to display the button only when the user desires, a physical switch for preventing an input operation to the touch panel is provided, or input by software is performed. It was necessary to set to temporarily disable the operation.

  The present invention has been made in view of such a situation. When an image is displayed on a display device having a touch panel, the image can be displayed more easily and the operability can be improved. To do.

  An image processing apparatus according to the present invention includes a display unit that displays an image, a touch panel that is provided to be superimposed on the display screen of the display unit, and that detects a user's contact with the display screen. A detection unit that detects only a contact as an effective operation and detects the user's contact with the specific region based on a detection result by the touch panel, and the specific unit is displayed in a state where a predetermined image is displayed on the display unit. When contact with an area is detected, a display control means is provided for causing the display means to display a specific image predetermined for the specific area together with the predetermined image.

  According to the present invention, when an image is displayed on a display device including a touch panel, the image can be displayed more easily and operability can be improved.

It is a figure which shows the structural example of one Embodiment of the imaging | photography system to which this invention is applied. It is a figure which shows the structural example of a camera control apparatus. It is a figure explaining an effective area | region and an invalid area | region. It is a figure which shows the example of a display of a menu. It is a flowchart explaining a contact position detection process. It is a flowchart explaining the menu display process corresponding to an upper left area. It is a figure which shows the structural example of other embodiment of an imaging | photography system.

  Embodiments to which the present invention is applied will be described below with reference to the drawings.

  FIG. 1 is a diagram illustrating a configuration example of an embodiment of an imaging system to which the present invention is applied.

  This photographing system includes a microscope 11, a camera 12, and a camera control device 13.

  The microscope 11 includes a stage on which a sample to be observed is placed, a light source that irradiates the sample with illumination light, and an imaging optical system that collects the illumination light from the sample and guides it to the camera 12. Do. That is, the microscope 11 irradiates the sample with illumination light, collects the illumination light from the sample, and enters the camera 12.

  The camera 12 is fixed to the microscope 11 and images an observation image with the sample as a subject by capturing an image by the imaging optical system of the microscope 11. An observation image photographed by the camera 12 is supplied from the camera 12 to the camera control device 13. The camera control device 13 displays an observation image supplied from the camera 12, receives a user operation, and executes a process according to the operation.

  More specifically, the camera control device 13 of FIG. 1 is configured as shown in FIG. That is, the camera control device 13 includes a display unit 41, a touch panel 42, a contact position detection unit 43, a recording unit 44, a control unit 45, and an image signal generation unit 46.

  The display unit 41 includes, for example, a liquid crystal display and displays various images such as an observation image on the display screen. The touch panel 42 is provided so as to be superimposed on the display screen of the display unit 41. The touch panel 42 detects contact of the user with the display screen (touch panel 42), and supplies a signal indicating the contact position of the user on the display screen to the contact position detection unit 43 as the detection result.

  The contact position detection unit 43 detects a user's contact with a predetermined specific area on the display screen based on a signal supplied from the touch panel 42, and supplies the detection result to the control unit 45. Further, the contact position detection unit 43 sets an effective area and an invalid area on the touch panel 42 according to the control of the control unit 45.

  Here, the effective area is an area in the touch panel 42 where an input operation by a user's contact is accepted as an effective operation. The invalid area is an area on the touch panel 42 and is an area where an input operation by a user's contact is not accepted as an invalid operation. That is, on the display screen, when the user touches an area that is an effective area and further instructs a predetermined operation, the instruction is accepted and processing corresponding to the instruction is executed. In addition, no processing is executed even if the user touches an invalid area on the display screen.

  The recording unit 44 is supplied via the control unit 45, an observation image taken by the camera 12, a GUI (Graphical User Interface) button or menu image to be displayed on the display unit 41, and a program for executing predetermined processing Etc. are recorded.

  The control unit 45 controls the overall operation of the camera control device 13. For example, the control unit 45 acquires an observation image from the camera 12 and supplies the observation image to the recording unit 44 or the image signal generation unit 46, or executes predetermined processing according to the detection result from the contact position detection unit 43. To do. The image signal generation unit 46 displays an image on the display screen of the display unit 41 according to control from the control unit 45.

  When the display of the observation image is instructed by the user's operation, the control unit 45 supplies the observation image acquired from the camera 12 or the observation image supplied from the camera 12 to the recording unit 44 and recorded in the recording unit 44. The image is supplied to the image signal generator 46. Then, the image signal generation unit 46 supplies the observation image supplied from the control unit 45 to the display unit 41 and displays the observation image on the display screen.

  Thereby, for example, the observation image shown in FIG. 3 is displayed on the display screen of the display unit 41. In the example of FIG. 3, on the display screen of the display unit 41, an image of a cell as an observation image is displayed at the center. In this state, menus and buttons for causing the camera control device 13 to execute various processes (functions) are not displayed on the display screen. However, the camera control device 13 has a function of specifying the position on the display screen using the entire area of the touch panel 42 and executing processing indicated by the icon or image displayed at the position.

  Further, when the power of the camera control device 13 is turned on, the control unit 45 makes a predetermined area near the four corners of the display screen of the display unit 41, specifically, the upper left corner with respect to the contact position detection unit 43. Only the area 71, the lower left area 72, the upper right area 73, and the lower right area 74 are set as effective areas.

  Therefore, in the example of FIG. 3, when the user performs any input operation by touching any one of the upper left area 71 to the lower right area 74, that is, the effective area, processing corresponding to the operation is executed. Is done. On the other hand, even if the user touches an area other than the effective area, that is, an invalid area such as the center area of the display screen, the input operation by the user is invalidated and no processing is performed.

  When the user touches the display screen of the display unit 41 with a finger, a signal indicating the contact position of the user is supplied from the touch panel 42 to the contact position detection unit 43. Therefore, the contact position detection unit 43 is based on the supplied signal. Then, contact with the effective area is detected, and the detection result is supplied to the control unit 45.

  For example, when a detection result indicating that contact with each of the upper left region 71 to the lower right region 74 is detected is supplied from the contact position detection unit 43 to the control unit 45, the control unit 45 controls the image signal generation unit 46. Then, a predetermined menu for these areas is displayed on the display screen. Specifically, when contact with each of the upper left area 71 to the lower right area 74 is detected, an observation image menu, a control menu, a mark menu, and a setting menu are displayed.

  The observation image menu is a menu related to the observation image. By performing an operation on the observation image menu, the user can instruct to save or read the observation image. The control menu is a menu related to the control of the camera 12, and the user can instruct the camera 12 to change the exposure, shutter speed, etc. by performing an operation on the control menu.

  The mark menu is a menu related to processing of the observation image, and by performing an operation on the mark menu, the user can process the observation image so that a predetermined mark, character, or the like is displayed on the observation image. Further, the setting menu is a menu related to the system setting of the camera control device 13, and the user can change various system settings in the camera control device 13 by performing an operation on the setting menu.

  For example, as shown in FIG. 3, when only the observation image is displayed on the display screen, when the user touches the upper left area 71, the observation image is displayed near the upper left area 71 of the display screen as shown in FIG. Menu 101 is displayed.

  The observation image menu 101 is provided with a save button 111, a read button 112, an enlargement / reduction button 113, and a cancel button 114. The user touches these buttons with a finger to operate each button. The execution of corresponding processing can be instructed.

  Specifically, the user can record the observation image displayed on the display screen in the recording unit 44 by operating the save button 111, and the recording unit 44 by operating the read button 112. The recorded observation image can be designated and displayed on the display screen.

  In addition, the user can enlarge and reduce the observation image displayed on the display screen by operating the enlargement / reduction button 113 and can display the observation image menu 101 by operating the cancel button 114. The display can be erased. That is, when the cancel button 114 is operated in the state shown in FIG. 4, the observation image menu 101 is not displayed, and the state returns to the state where only the observation image is displayed on the display screen shown in FIG.

  Next, with reference to the flowchart of FIG. 5, a contact position detection process that is performed when the camera control device 13 detects contact with the display screen (touch panel 42) of the user will be described. The contact position detection process is started when a touch on the display screen of the user is detected by the touch panel 42 and a signal indicating the contact position of the user is supplied from the touch panel 42 to the contact position detection unit 43.

  In step S <b> 11, the contact position detection unit 43 determines whether or not the contact position of the user is a position within the effective area based on the signal supplied from the touch panel 42. For example, immediately after the power source of the camera control device 13 is turned on, only the upper left area 71 to the lower right area 74 are effective areas, so that the contact position is one of the upper left area 71 to the lower right area 74. If it is within the area, it is determined that the position is within the effective area. In step S11, only the observation image is displayed.

  If it is determined in step S11 that the contact position is not within the valid area, that is, if the area of the display screen touched by the user is an invalid area, the touch on the display screen by the user is an input for instructing execution of the process or the like It is determined that the operation is not performed, and the contact position detection process ends.

  Thus, even if the user touches the invalid area with a finger, nothing is displayed on the display unit 41 and no processing is executed. The upper left area 71 to the lower right area 74, which are effective areas, are areas near the edge of the display screen.

  For this reason, for example, when the user is having a discussion with another person, even if the desired position of the subject on the observation image is pointed with a finger, the user touches the effective area and the menu is displayed by mistake. There is no such thing. In particular, when observing a sample with the microscope 11, the subject is often located at the center of the observation image. Therefore, if the effective area is set near the end of the display screen, a menu or the like is intentionally displayed due to an erroneous operation. It is possible to prevent other than being displayed.

  In addition, when the user is not touching the display screen, only the observation image is displayed on the display screen and no menus or buttons are displayed. Therefore, the observation image can be displayed larger, that is, easy to see. In addition, the menu is displayed only when necessary, so that the appearance is improved. This is particularly effective when the display screen is enlarged by a projector or the like and shown to others.

  On the other hand, when it is determined in step S11 that the contact position is within the effective area, in step S12, the contact position detection unit 43 determines that the contact position is within the upper left area 71 based on the signal supplied from the touch panel 42. It is determined whether it is a position.

  If it is determined in step S12 that the position is within the upper left area 71, in step S13, the camera control device 13 performs menu display processing corresponding to the upper left area to display the observation image menu 101 on the display screen. . Then, when the menu display process corresponding to the upper left area is performed, the contact position detection process ends. Details of the menu display process corresponding to the upper left area will be described later.

  If it is determined in step S12 that the position is not in the upper left area 71, the contact position detection unit 43 determines that the contact position is in the lower left area 72 based on the signal supplied from the touch panel 42 in step S14. It is determined whether or not.

  If it is determined in step S14 that the position is in the lower left area 72, in step S15, the camera control device 13 performs a menu display process corresponding to the lower left area to display the control menu on the display screen. When the menu display process corresponding to the lower left area is performed, the contact position detection process ends.

  On the other hand, when it is determined in step S14 that the position is not in the lower left area 72, in step S16, the contact position detector 43 determines that the contact position is in the upper right area 73 based on the signal supplied from the touch panel 42. It is determined whether or not the position is within.

  If it is determined in step S16 that the position is in the upper right area 73, in step S17, the camera control device 13 performs a menu display process corresponding to the upper right area to display a mark menu on the display screen. When the menu display process corresponding to the upper right area is performed, the contact position detection process ends.

  Furthermore, when it is determined in step S16 that the position is not in the upper right area 73, that is, when the contact position of the user is in the lower right area 74, in step S18, the camera control device 13 A menu display process corresponding to is performed to display a setting menu on the display screen. Then, when the menu display process corresponding to the lower right area is performed, the contact position detection process ends.

  In this way, the camera control device 13 divides the entire area of the display screen into a valid area where the user's input operation is valid and an invalid area where the input operation is invalid. When the contact with the effective area is detected, the camera control device 13 displays a predetermined menu for the contacted area, and nothing is detected even when the contact with the invalid area is detected. Do not perform processing.

  In this way, the menu and buttons are not displayed on the display screen in advance, and the menu is displayed with the input operation enabled only when contact with the effective area is detected, thereby making it easier to see the image on the display screen. While displaying, the operativity of the camera control apparatus 13 can be improved. That is, for example, when the user touches the display screen, it is possible to prevent the menu from being displayed even though the user does not intend, and the user can simply touch the predetermined effective area. , You can easily display the menu.

  Next, a menu display process corresponding to the upper left area corresponding to the process of step S13 of FIG. 5 will be described with reference to the flowchart of FIG.

  In step S41, the image signal generation unit 46 displays the observation image menu 101.

  That is, when contact with the upper left region 71 is detected by the contact position detection unit 43, the contact position detection unit 43 supplies a signal indicating that contact with the upper left region 71 has been detected to the control unit 45. Then, the control unit 45 acquires an image for displaying a predetermined observation image menu 101 for the upper left region 71 from the recording unit 44 in accordance with a signal from the contact position detection unit 43 and obtains an image signal. It supplies to the production | generation part 46. FIG.

  From the image signal of the observation image displayed on the display unit 41 and the image signal of the image for displaying the menu supplied from the control unit 45, the image signal generation unit 46 displays the observation image menu 101 in the observation image. An image signal to be displayed in a superimposed manner is generated. Then, the image signal generation unit 46 supplies the generated image signal to the display unit 41 to display the observation image menu 101 together with the observation image on the display screen of the display unit 41. Thereby, for example, the observation image menu 101 shown in FIG. 4 is displayed.

  When the observation image menu 101 is displayed on the display screen, the control unit 45 sets the area where the observation image menu 101 is displayed on the display screen as an effective area for the contact position detection unit 43. To instruct.

  In step S <b> 42, the contact position detection unit 43 sets an area where the observation image menu 101 is displayed on the display screen as an effective area in accordance with an instruction from the control unit 45. Thus, when the user touches the observation image menu 101 with a finger and performs an input operation instructing execution of each process, the input operation is validated and a process corresponding to the instruction is performed. Even in this case, each of the upper left area 71 to the lower right area 74 remains an effective area.

  In step S43, the control unit 45 determines whether or not an operation is performed on the observation image menu 101 within a predetermined valid time.

  For example, when the user touches the save button 111 of the observation image menu 101 in FIG. 4 with a finger, a signal indicating the user's contact position is supplied from the touch panel 42 to the contact position detection unit 43. Detects contact with the save button 111 from the signal. Then, the contact position detection unit 43 supplies a signal indicating that the save button 111 has been operated to the control unit 45, so that the control unit 45 determines that the user save button 111 is received from the signal supplied from the contact position detection unit 43. You can know the contact to.

  After the observation image menu 101 is displayed, the control unit 45, more specifically, after the observation image menu 101 is displayed, the control unit 45 performs the last operation on the observation image menu 101 and saves it within the effective time. When the operation is performed, it is determined that the operation is performed within the valid time.

  This valid time can be changed to an arbitrary length by the user performing an operation on the setting menu defined for the lower right region 74.

  If it is determined in step S43 that the operation has not been performed within the effective time, the user does not intend to operate the observation image menu 101, and the process proceeds to step S46.

  On the other hand, when it is determined in step S43 that the operation is performed within the effective time, in step S44, the control unit 45 performs a process according to the user's operation.

  For example, when the save button 111 in FIG. 4 is operated, the control unit 45 also supplies the observation image supplied to the display unit 41 via the image signal generation unit 46 to the recording unit 44. To record the observation image.

  In step S45, the control unit 45 determines whether or not to accept the next input operation. For example, when the read button 112 is operated in a state where the observation image menu 101 in FIG. 4 is displayed, a screen for designating an observation image to be read is displayed on the display screen. It is necessary to perform an input operation on the screen and specify an observation image. In such a case, after the screen for designating the observation image is displayed in step S44, it is necessary to further accept an input operation on the touch panel 42 of the user. Therefore, when the next input operation is accepted in step S45. Determined.

  If it is determined in step S45 that the next input operation is accepted, the process returns to step S43, and the above-described process is repeated.

  On the other hand, if it is determined in step S45 that the next input operation is not accepted, the process proceeds to step S46.

  If it is determined in step S45 that the input operation is not accepted, or if it is determined in step S43 that the operation is not performed within the effective time, the contact position detection unit 43 displays the observation image menu 101 in step S46. Is the invalid area.

  That is, the camera control device 13 executes a process instructed by the user when no operation is performed on the observation image menu 101 until the effective time elapses after the observation image menu 101 is displayed, When it becomes unnecessary to display the observation image menu 101, the display of the observation image menu 101 is deleted.

  Since the display area is an effective area while the observation image menu 101 is displayed, it is necessary to prevent the input operation to the display area from being accepted when the display of the observation image menu 101 is deleted. There is. Therefore, when the display of the observation image menu 101 is deleted, the control unit 45 instructs the contact position detection unit 43 to set the area where the observation image menu 101 is displayed as an invalid area.

  Then, the contact position detection unit 43 sets the area where the observation image menu 101 is displayed as an invalid area in accordance with an instruction from the control unit 45. As a result, only the upper left area 71 to the lower right area 74 on the display screen are set as effective areas.

  When the area of the observation image menu 101 is set as an invalid area, the control unit 45 instructs the image signal generation unit 46 to delete the display of the observation image menu 101.

  In step S <b> 47, the image signal generation unit 46 deletes the display of the observation image menu 101 according to the instruction of the control unit 45. That is, the image signal generation unit 46 supplies the observation image supplied from the control unit 45 to the display unit 41 and displays only the observation image on the display screen.

  When the display of the observation image menu 101 is erased from the display screen, the menu display process corresponding to the upper left area ends. When the menu display process corresponding to the upper left area is completed, the process of step S13 in FIG. 5 is performed, so that the contact position detection process is also ended.

  In this way, the camera control device 13 displays the observation image menu 101 when the upper left area 71 is operated. Then, when there is an operation on the observation image menu 101, the camera control device 13 executes processing corresponding to the operation, and when there is no operation within the effective time, the display of the observation image menu 101 is deleted.

  As described above, when the operation is not performed within the effective time, the display of the observation image menu 101 is deleted, so that the user can perform the operation even if the observation image menu 101 is displayed by mistake. The observation image menu 101 can be deleted. Thereby, the operativity of the camera control apparatus 13 can be improved.

  More specifically, for example, as illustrated in FIG. 4, when the user operates any one of the lower left region 72 to the lower right region 74 in a state where the observation image menu 101 is displayed on the display screen, The displayed observation image menu 101 is deleted. Then, a predetermined menu such as a setting menu is displayed for the newly operated area.

  In addition, the menu display process corresponding to the upper left area described with reference to FIG. 6 is also different in the above-described steps S15, S17, and S18 of FIG. The same processing is performed.

  For example, in the menu display process corresponding to the lower left area in step S15, a control menu is displayed on the display screen, and the control unit 45 performs a process of controlling the settings and operations of the camera 12 according to the user's operation. In the menu display process corresponding to the upper right area in step S17, a mark menu is displayed, and the image signal generation unit 46 marks on the observation image a circle or the like surrounding a predetermined part of the subject in response to a user operation. Is displayed.

  Further, for example, in the menu display process for the lower right area in step S18, a setting menu is displayed on the display screen, and the control unit 45 changes the setting such as the above-described effective time according to the user's operation, and the setting after the change is made. For example, the recording unit 44 records the information indicating the above.

  In the above description, it has been described that the display unit 41 and the touch panel 42 are provided in the camera control device 13 itself that controls the camera 12. However, the display unit 41 and the touch panel 42 may be provided separately.

  In such a case, the photographing system is configured as shown in FIG. 7, for example. In FIG. 7, parts corresponding to those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  In the photographing system of FIG. 7, the camera 12 is fixed to the microscope 11, and the camera control device 141 is connected to the camera 12. The camera control device 141 includes the contact position detection unit 43 to the image signal generation unit 46 shown in FIG. That is, the camera control device 141 and the camera control device 13 are different in that the display unit 41 and the touch panel 42 are not provided in the camera control device 141, and other points are the same.

  A display unit 41 is connected to the camera control device 141, and a touch panel 42 is superimposed on the display screen of the display unit 41. The signal from the touch panel 42 is supplied to the contact position detection unit 43 of the camera control device 141, and the image from the image signal generation unit 46 of the camera control device 141 is supplied to the display unit 41.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

  11 microscope, 12 camera, 13 camera control device, 41 display unit, 42 touch panel, 43 contact position detection unit, 45 control unit, 46 contact position detection unit, 141 camera control device

Claims (6)

Display means for displaying an image;
A touch panel provided to be superimposed on the display screen of the display means and detecting a user's contact with the display screen;
Only a contact to a specific area on the touch panel is an effective operation, and based on a detection result by the touch panel, detection means for detecting the user's contact to the specific area,
When contact with the specific area is detected in a state where the predetermined image is displayed on the display means, a specific image predetermined for the specific area is displayed on the display means together with the predetermined image. An image processing apparatus comprising: display control means for displaying. The image processing apparatus according to claim 1, wherein the display control unit displays a menu for executing a predetermined process as the specific image. 3. The detection unit according to claim 1 or 2, wherein when the specific image is displayed, an effective operation is to touch a region on the display screen where the specific image is displayed. Image processing apparatus. The display control means, when the contact with the area where the specific image is displayed on the display screen is not detected for a predetermined effective time or more after the specific image is displayed, The image processing apparatus according to claim 3, wherein the display is erased. 5. The image according to claim 4, wherein when the display of the specific image is erased, the detection unit makes an invalid operation to contact the area on the display screen where the specific image is displayed. Processing equipment. The image processing apparatus according to any one of claims 1 to 5,
It is fixed to a microscope, and includes, as the predetermined image, photographing means for photographing an image of an observation object that is observed in the microscope,
The display control means causes the display means to display only the image to be observed before contact with the specific area is detected.

Images