[go: up one dir, main page]

EP2362342A1 - Image processing apparatus, method, and computer-readable medium - Google Patents

Image processing apparatus, method, and computer-readable medium Download PDF

Info

Publication number
EP2362342A1
EP2362342A1 EP10014904A EP10014904A EP2362342A1 EP 2362342 A1 EP2362342 A1 EP 2362342A1 EP 10014904 A EP10014904 A EP 10014904A EP 10014904 A EP10014904 A EP 10014904A EP 2362342 A1 EP2362342 A1 EP 2362342A1
Authority
EP
European Patent Office
Prior art keywords
image
display
zoom magnification
processor
center position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP10014904A
Other languages
German (de)
English (en)
French (fr)
Inventor
Shigeatsu Yoshioka
Masashi Kimoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of EP2362342A1 publication Critical patent/EP2362342A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/368—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements details of associated display arrangements, e.g. mounting of LCD monitor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/541—Interprogram communication via adapters, e.g. between incompatible applications
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing

Definitions

  • Patent Document 1 discloses a method in which an image optically obtained by a microscope is digitized by a video camera with a CCD (charge coupled device), a digital signal is input to a control computer system, and the image is visualized ) on a monitor. A pathologist performs examination while watching the image displayed on the monitor (see, for example, paragraphs [0027] and [0028] and Fig. 5 of Patent Document 1).
  • CCD charge coupled device
  • a person who gives a diagnosis uses an operation means such as a mouse and a keyboard to shift or perform zoom-in or zoom-out on an observation position of the digital pathological image on the screen of the monitor.
  • an operation means such as a mouse and a keyboard
  • zoom-in or zoom-out on an observation position of the digital pathological image on the screen of the monitor.
  • a program of processing a browse of the digital pathological image performs a display processing in accordance with the command.
  • a typical program performs processing of the zoom-in or zoom-out of an image with the center of the image displayed on the screen being set as a reference. For this reason, in the case where a region of a part of the image displayed is intended to be observed in detail by performing the zoom-in, the operator first has to input, using the operation means, a command for shifting the desired region of the image displayed to approximately the center of the screen, and input a command for performing the zoom-in on the region using the operation means upon completion of the shift. In this way, a plurality of operation steps are needed, which is a factor of deterioration of the operation efficiency.
  • processing of shifting the display range of the image with respect to a dragging operation of a mouse is allocated in many cases.
  • the shift of the display range of the image is limited up to a position of the end of the screen to which a cursor pointer can be moved.
  • an information processing apparatus capable of desirably performing observation of an image through a change in zoom magnification for display.
  • the present disclosure relates to an information processing apparatus, a method, and a computer-readable medium for controlling the display of an image obtained by a microscope in the field of medicine, pathology, biology, materials science, or the like.
  • an information processing apparatus includes a processor, a display device operatively coupled to the processor, an input device operatively coupled to the processor, and a memory device operatively coupled to the processor, the memory device storing instructions that cause the processor, in cooperation with the display device, the input device and the memory device, to: (a) display a first image associated with an observation target object (e.g., a section of biological tissue), the first image having: (i) a first zoom magnification; and (ii) a first display range having a first center position; (b) enable a user to change the first zoom magnification by selecting a first position of the displayed first image; and (c) in response to the first position being selected, display a second image associated with the observation target image, the second image having: (i) a second zoom magnification which is different from the first zoom magnification; and (ii) a second display range having a second center position which is different from the first center position, the second center position corresponding to the selected position.
  • an observation target object
  • the displayed first image is observed by a microscope.
  • the instructions cause the processor to operate with the input device to enable the user to select the first position of the displayed first image using a displayed cursor pointer. In one example embodiment, when the first position is selected, a second position of the displayed cursor pointer corresponds to the selected first position. In one example embodiment, the instructions cause the processor to operate with the display device to, in response to the first position being selected, display the cursor pointer at the second center position.
  • the instructions cause the processor to operate with the display device to, before the second image is displayed, display a third image.
  • the third image has a third zoom magnification which is different from the first zoom magnification and the second zoom magnification.
  • the third image has a third display range having a third center position which is different from the first center position and the second center position.
  • the displayed third image includes a third position which corresponds to the selected first position of the first image.
  • a first distance between the third position and the third center position is smaller than a second distance between the selected first position and the first center position.
  • the instructions cause the processor to operate with the display device to display a cursor pointer at the third position.
  • the information processing apparatus operates using a first mode.
  • the instructions cause the processor to operate with the input device to: (i) enable the user change the operation of the information processing apparatus from the first mode to a second, different mode; and (ii) in response to the user changing the operation of the information processing apparatus to the second, different mode, and in response to the position being selected, display a fourth image associated with the observation target image.
  • the fourth image has a fourth zoom magnification which is different from the first zoom magnification.
  • the fourth image also has a fourth display range having a fourth center position which corresponds to the first center position.
  • the instructions cause the processor to: (a) after the second image is displayed, enable the user to change the second zoom magnification by zooming out; and (b) in response to the to second zoom magnification being changed by zooming out, display a fifth image having a fifth display range having a fifth center position which corresponds to the second center position.
  • a method of operating an information processing apparatus including instructions includes causing a processor to execute the instructions to operate with a display device to display a first image associated with an observation target object (e.g., a section of biological tissue).
  • the first image has a first zoom magnification and a first display range having a first center position.
  • the method includes causing the processor to execute the instructions to operate with an input device to enable a user to change the first zoom magnification by selecting a first position of the displayed first image.
  • the method includes, in response to the first position being selected, causing the processor to execute the instructions to operate with the display device to display a second image associated with the observation target image.
  • the second image has: (i) a second zoom magnification which is different from the first zoom magnification; and (ii) a second display range having a second center position which is different from the first center position.
  • the second center position corresponds to the selected position.
  • the displayed first image is observed by a microscope.
  • the method includes causing the processor to execute the instructions to operate with the input device to enable the user to select the first position of the displayed first image using a displayed cursor pointer.
  • a second position of the displayed cursor pointer corresponds to the selected first position.
  • the method includes, in response to the first position being selected, causing the processor to execute the instructions to operate with the display device to display the cursor pointer at the second center position.
  • the method includes causing the processor to execute the instructions to operate with the display device to, before the second image is displayed, display a third image having: (a) a third zoom magnification which is different from the first zoom magnification and the second zoom magnification; and (b) a third display range having a third center position which is different from the first center position and the second center position.
  • the displayed third image includes a third position which corresponds to the selected first position of the first image.
  • a first distance between the third position and the third center position is smaller than a second distance between the selected first position and the first center position.
  • the method includes causing the processor to execute the instructions to operate with the display device to display a cursor pointer at the third position.
  • the information processing apparatus operating using a first mode.
  • the method includes causing the processor to execute the instructions to operate with the input device to: (i) enable the user change the operation of the information processing apparatus from the first mode to a second, different mode; and (ii) in response to the user changing the operation of the information processing apparatus to the second, different mode, and in response to the position being selected, display a fourth image associated with the observation target image.
  • the fourth image has a fourth zoom magnification which is different from the first zoom magnification.
  • the fourth image also has a fourth display range having a fourth center position which corresponds to the first center position.
  • the method includes causing the processor to execute the instructions to operate with the input device to, after the second image is displayed, enable the user to change the second zoom magnification by zooming out.
  • the method includes, in response to the to second zoom magnification being changed by zooming out, causing the processor to execute the instructions to operate with the display device to display a fifth image having a fifth display range having a fifth center position which corresponds to the second center position.
  • a computer-readable medium stores instructions structured to cause an information processing apparatus to display a first image associated with an observation target object.
  • the first image has (i) a first zoom magnification; and (iii) a first display range having a first center position.
  • the instructions are further structured to cause the information processor apparatus to (a) enable a user to change the first zoom magnification by selecting a position of the displayed first image; and (c) in response to the position being selected, display a second image associated with the observation target image.
  • the second image has: (i) a second zoom magnification which is different from the first zoom magnification; and (ii) a second display range having a second center position which is different from the first center position.
  • the second center position corresponds to the selected position.
  • the image can be desirably observed through the change the zoom magnification of the display.
  • Fig. 1 is a diagram showing the outline of an example image processing system according to an example embodiment of the present disclosure.
  • Fig. 1 is a block diagram showing the structure of an example computer system including at least an information processing apparatus according to an example embodiment of the present disclosure.
  • Fig. 2 is a diagram showing an example image pyramid structure of image data.
  • Fig. 3 is a diagram showing a relationship between the image pyramid structure and a change in zoom magnification of an example display image in a center fixation mode.
  • Fig. 4 is a diagram showing a relationship between the image pyramid structure and the change in the zoom magnification of the example display image in a center variability mode.
  • Fig. 5 is a diagram showing a functional structure for changing an image display range with the change in the zoom magnification in an example information processing apparatus according to an example embodiment.
  • Fig. 6 is a diagram for explaining an example zoom-in in the center fixation mode.
  • Fig. 7 is a diagram for explaining an example zoom-in in the center variability mode.
  • Fig. 8 is a diagram showing a state where the example display image is changed in the center variability mode.
  • Fig. 9 is a diagram for explaining shift of the example display range with a mouse dragging operation.
  • Fig. 1 is a block diagram showing the structure of an example computer system including at least an information processing apparatus according to an example embodiment of the present disclosure.
  • a PC personal computer 100 is used, for example.
  • the PC 100 includes a CPU (central processing unit) 101, a ROM (read only memory) 102, a RAM (random access memory) 103, an input and output interface (hereinafter, abbreviated as I/O interface) 105, and a bus 104 that connects those components with one another.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • I/O interface input and output interface
  • a display unit 106 To the I/O interface 105, a display unit 106, an input unit 107, a storage unit 108, a communication unit 109, a drive unit 110, and the like are connected.
  • the display unit 106 is a display device that uses liquid crystal, EL (electroluminescence), a CRT (cathode ray tube), or the like.
  • the input unit 107 is, for example, a pointing device, a keyboard, a touch panel, or another operation apparatus.
  • the input unit 107 includes a touch panel, the touch panel may be integrated with the display unit 106.
  • the storage unit 108 is a non-volatile memory such as an HDD (hard disk drive), a flash memory, and another solid-state memory.
  • the drive unit 110 is a device capable of driving a removable recording medium 111 such as an optical recording medium, a floppy (registered trademark) disk, a magnetic recording tape, and a flash memory.
  • the storage unit 108 is often used as a device that is previously included in the PC 100 and mainly drives a recording medium that is not removable.
  • the communication unit 109 is a modem, a router, or another communication apparatus that is connectable to a LAN (local area network), a WAN (wide area network), or the like and is used for communicating with another device.
  • the communication unit 109 may perform either one of a wired communication or a wireless communication.
  • the communication unit 109 is used separately from the PC 100 in many cases.
  • Fig. 2 is a diagram showing a pyramid structure of the image data.
  • target image data has a pyramid structure of image data obtained by picking up an image of an observation target object using an image pickup means of a high resolution.
  • the pyramid structure of the image data refers to a structure in which a plurality of pieces of the image data at a plurality of resolutions obtained by reducing a resolution of an original image data stepwise are generated and set in a layered manner.
  • the image data in each layer is divided into regions called "tiles" at a predetermined resolution. If the layers of the pyramid structure are represented by an N-th layer, an (N-1)-th layer, an (N-2)-th layer, ...
  • the numbers of tiles of the layers are determined to be 2 N *2 N , 2 N-1 *2 N-1 , 2 N-2 *2 N-2 , ... , 1, respectively. It should be noted that the resolution of one tile is 256 x 256 (pixel) or 256 X 512 (pixel), for example.
  • the information processing apparatus (PC 100) of this example embodiment When receiving a specification of an arbitrary resolution and a display range of an image by a user, the information processing apparatus (PC 100) of this example embodiment reads corresponding image data from among the image pyramid structure by the tile, buffers the data read in a display-purpose buffer, and displays an image on the display unit 106. In addition, in the case where the user gives an instruction for shifting the display range of the image displayed on the display unit 106, the information processing apparatus (PC 100) reads image data of a shift destination from among the image data items at the same resolution by the tile in accordance with the instruction and updates the content of the display-purpose buffer, thereby displaying the image of the shift destination on the display unit 106.
  • the "display range of the image” refers to a region of image data that is actually displayed on a physical screen in an entire image data.
  • the information processing apparatus PC 100 reads necessary image data by the tile from among image data items at a resolution corresponding to the zoom magnification specified and updates the content of the display-purpose buffer, thereby changing the zoom magnification of the display image.
  • the size of an image display range in the physical image is set to be constant, when the zoom magnification is increased (when the zoom-in operation is performed), the display range of the image is reduced, while when the zoom magnification is decreased (when the zoom-out operation is performed), the display range of the image is increased.
  • zoom magnification zoom-in or zoom-out
  • Fig. 3 is a diagram showing a relationship between the image pyramid structure and the change in the zoom magnification of the display image.
  • image data D3 on an (N-3)-th layer is constituted of 2 x 2 tiles, which is the same size as the display range of the image. Therefore, the entire image thereof is displayed on the physical screen as the display range.
  • a region of the 2 x 2 tiles in image data D2 that is constituted of 4 x 4 tiles on the (N-2)-th layer corresponds to a display range 1 of the image. As a result, the image is displayed at 2x zoom.
  • a region of the 2 x 2 tiles in image data D1 that is constituted of 8 x 8 tiles on the (N-1)-th layer corresponds to the display range 1 of the image.
  • the image is displayed at 4x zoom.
  • a region of the 2 x 2 tiles in image data D0 that is constituted of 16 x 16 tiles on the N-th layer corresponds to the display range 1 of the image.
  • the image is displayed at 8x zoom.
  • the zoom-out As described above, when the zoom magnification is changed, the resolution is changed, with the result that the display range 1 of the image, that is, the image from the viewpoint of the user is changed.
  • two modes are prepared as methods of changing the display range 1 of the image with the change in the zoom magnification.
  • One is a "center fixation mode”
  • the other is a "center variability mode”.
  • the center fixation mode the center position of the display range 1 in a coordinate space of the original image (image data on the N-th layer) is not varied before and after the change in the zoom magnification.
  • the center variability mode the center position of the display range 1 in the coordinate space of the original image is varied before and after the change in the zoom magnification.
  • the display range 1 of the image is changed with the change in the zoom magnification so that the coordinates corresponding to a position on the screen that is indicated by a cursor pointer C1 before the change in the zoom magnification in the coordinate space of the original image is coincided with the center position of the display image after the change in the zoom magnification.
  • Fig. 4 shows the case where the cursor pointer on the screen is shifted from a position of C0 to the position of C1 in the state where the image data of the (N-1)-th layer is displayed, and then the instruction of the zoom-in is given.
  • the two modes can be used separately as necessary based on a setting set by the user. That is, with the use of the input unit 107, the user can make a setting so that either one of the modes is effective.
  • the CPU 101 stores the content of the setting in the storage unit 108.
  • the CPU 101 Upon reception of the instruction for changing the zoom magnification from the user through the input unit 107, the CPU 101 performs control to change the display range of the image in either of the two modes described above in accordance with the content of the setting stored in the storage unit 108.
  • Fig. 5 is a diagram showing a functional structure for changing the image display range with the change in the zoom magnification.
  • the information processing apparatus (PC 100) of this example embodiment includes a cursor pointer coordinate calculation unit 201, a cursor pointer coordinate storage unit 202, and a display processing unit 203, as the functional structure for changing the image display range with the change in the zoom magnification.
  • Those functional units are provided as a program for causing the typical computer as described above to function.
  • the program is stored in the storing means such as the storage unit 108, and the CPU 101 loads the program from the storage unit 108 to the RAM (random access memory) 103 as the main memory in order to display the image data on the display unit 106, and interprets and executes the program.
  • the functional units are as follows.
  • the cursor pointer coordinate calculation unit 201 calculates, based on the positional data of a cursor pointer on the screen, the coordinates in the original image coordinate space that are indicated by the cursor pointer.
  • the cursor pointer coordinate storage unit 202 stores the latest coordinate data of the cursor pointer which is calculated by the cursor pointer coordinate calculation unit 201.
  • the display processing unit 203 Upon input of a zoom magnification change request including a value of a zoom magnification of a change destination using the input unit 107 by the user, the display processing unit 203 changes the zoom magnification of the display image in accordance with a preset mode (center fixation mode or center variability mode). Specifically, in the case where the center fixation mode is set, as shown in Fig. 6 , the display processing unit 203 changes the zoom magnification without changing the coordinates of the center in the original image coordinate space of the display image before and after the change of the zoom magnification. On the other hand, in the case where the center variability mode is set, as shown in Fig.
  • the display processing unit 203 obtains, from the cursor pointer coordinate storage unit 202, the coordinate data of the original image coordinate space corresponding to a position on the screen that is indicated by a cursor pointer C and changes the zoom magnification so that the coordinates are coincided with the center position of the display image after the change in the zoom magnification.
  • Fig. 8 is a diagram showing a state where the zoom magnification is changed (zoom-in operation is performed) in the center variability mode.
  • (A) is set as a display image before the change in the zoom magnification.
  • the display image is based on the image data D3 of the 2 x 2 tiles on the (N-3)-th layer in the image data block structure.
  • the cursor pointer C is displayed on the screen of the display unit 106 on which the display image is displayed.
  • the cursor pointer C can be moved in any direction by any distance on the screen by operating a mouse or the like by the user.
  • the assumption is made that the cursor pointer C is operated by the user using the mouse or the like and is moved to a position shown in (A) of Fig. 8 .
  • the state of the image display is shifted from the state of the image display on the (N-3)-th layer shown in (A) of Fig. 8 , through the state of an image display on the (N-2)-th layer shown in (B) of Fig. 8 and the state of an image display on the (N-1)-th layer shown in (C) of Fig. 8 , to the state of an image display on the N-th layer shown in (D) of Fig.
  • the center position of the display image in the image display state on the N-th layer corresponds to the coordinates in the original image coordinate space that are indicated by the cursor pointer C at the time when the zoom-in instruction is given in the image display state on the (N-3)-th layer.
  • the shift to the image display state at the target zoom magnification is carried out through the display image at the zoom magnification corresponding to the in-between layer.
  • the display processing unit 203 changes the display ranges of the images at the respective resolutions so that the center positions of the display images at the resolutions gradually get close to the coordinates in the original image coordinate space that are indicated by the cursor pointer C in the image display state at the resolution corresponding to the original zoom magnification.
  • the image display state is shifted from the image display state on the N-th layer shown in (D) of Fig. 8 , through the image display state on the (N-1)-th layer shown in (E) of Fig. 8 and the image display state on the (N-2)-th layer shown in (F) of Fig. 8 , to the image display state on the (N-3)-th layer shown in (G) of Fig. 8 .
  • the shift to the image display state at the target zoom magnification is carried out through the image display at the zoom magnification corresponding to the in-between layer.
  • the display processing unit 203 also changes the display ranges of the images at the resolutions so that the center positions of the display images at the respective resolutions gradually get close to the coordinates in the original image coordinate space that are indicated by the cursor pointer C in the image display state at the resolution corresponding to the original zoom magnification.
  • the zoom-in display and the zoom-out display are implemented in a visually natural manner.
  • the display image is changed to one at a higher resolution step by step and displayed.
  • the fear that the operator misses the part that is necessary to be observed is reduced, which can increase the efficiency of the operation.
  • the position of the part that is necessary to be observed is moved to the center of the display image step by step, so the operator can be further prevented from missing the part that is necessary to be observed.
  • the display processing unit 203 shifts the display range of the image along with the movement operation of the cursor pointer C with a mouse. At this time, the display processing unit 203 can shift the display range of the image on the basis of the output from the mouse for the movement operation of the cursor pointer C irrespective of the movable range of the cursor pointer C on the screen.
  • Fig. 9 is a diagram for explaining the shift of the display range of the image with the mouse dragging.
  • (A) to (D) of Fig. 9 the state in which the shift of the display range of the image with the mouse dragging is shown in a chronological order.
  • the display processing unit 203 performs processing so as to shift the display range of the image in accordance with the mouse dragging operation as follows. First, as shown in (A) of Fig. 9 , the assumption is made that the cursor pointer C of the mouse is set on the display image. In this state, when the cursor pointer C is moved leftward in (A) of Fig. 9 with the mouse dragging operation, the display processing unit 203 shifts the display range of the image by the amount corresponding to the amount of movement of the cursor pointer C in the movement direction. In (B) of Fig. 9 , the state is shown in which the cursor pointer C reaches the end of the display range of the screen with the mouse dragging operation.
  • the display range of the image is shifted with the movement of the cursor pointer C with the mouse dragging operation.
  • the display processing unit 203 shifts only the display range of the image with the cursor pointer C being put on the end of the display range of the screen. In (C) and (D) of Fig. 8 , the shift of the display range of the image at this time is shown.
  • the shift of the display range of the image with the movement operation of the cursor pointer C with the mouse dragging operation can be performed irrespective of the limitation of the movement of the cursor pointer C on the screen, which significantly improves the operability for the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Microscoopes, Condenser (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)
EP10014904A 2009-11-30 2010-11-23 Image processing apparatus, method, and computer-readable medium Ceased EP2362342A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2009272841A JP5658451B2 (ja) 2009-11-30 2009-11-30 情報処理装置、情報処理方法及びそのプログラム

Publications (1)

Publication Number Publication Date
EP2362342A1 true EP2362342A1 (en) 2011-08-31

Family

ID=43708822

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10014904A Ceased EP2362342A1 (en) 2009-11-30 2010-11-23 Image processing apparatus, method, and computer-readable medium

Country Status (5)

Country Link
US (3) US9324124B2 (ja)
EP (1) EP2362342A1 (ja)
JP (1) JP5658451B2 (ja)
KR (1) KR20110060820A (ja)
CN (1) CN102081495B (ja)

Families Citing this family (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9310907B2 (en) 2009-09-25 2016-04-12 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
EP3855297A3 (en) 2009-09-22 2021-10-27 Apple Inc. Device method and graphical user interface for manipulating user interface objects
US8832585B2 (en) * 2009-09-25 2014-09-09 Apple Inc. Device, method, and graphical user interface for manipulating workspace views
US8799826B2 (en) 2009-09-25 2014-08-05 Apple Inc. Device, method, and graphical user interface for moving a calendar entry in a calendar application
US8766928B2 (en) 2009-09-25 2014-07-01 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US8612884B2 (en) * 2010-01-26 2013-12-17 Apple Inc. Device, method, and graphical user interface for resizing objects
JP5751608B2 (ja) * 2010-02-05 2015-07-22 日本電気株式会社 ズーム処理装置、ズーム処理方法、及びコンピュータプログラム
CN102985942B (zh) * 2010-06-30 2016-09-14 皇家飞利浦电子股份有限公司 放大显示的图像
US9081494B2 (en) 2010-07-30 2015-07-14 Apple Inc. Device, method, and graphical user interface for copying formatting attributes
US9098182B2 (en) 2010-07-30 2015-08-04 Apple Inc. Device, method, and graphical user interface for copying user interface objects between content regions
US8972879B2 (en) 2010-07-30 2015-03-03 Apple Inc. Device, method, and graphical user interface for reordering the front-to-back positions of objects
CN102760025A (zh) * 2011-04-26 2012-10-31 富泰华工业（深圳）有限公司 图片浏览系统及图片缩放方法和图片切换方法
JP5889559B2 (ja) 2011-07-13 2016-03-22 ソニー株式会社 情報処理方法および情報処理システム
CA2843468A1 (en) 2011-07-27 2013-01-31 Michael Meissner Systems and methods in digital pathology
JP5803442B2 (ja) * 2011-08-31 2015-11-04 株式会社ニコン 顕微鏡制御装置、顕微鏡装置、画像処理装置およびプログラム
JP5893315B2 (ja) * 2011-09-27 2016-03-23 オリンパス株式会社 顕微鏡システム
JP5548671B2 (ja) * 2011-12-27 2014-07-16 株式会社ソニー・コンピュータエンタテインメント 画像処理システム、画像提供サーバ、情報処理装置、および画像処理方法
JP2013152454A (ja) * 2011-12-27 2013-08-08 Canon Inc 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム
JP2013152453A (ja) * 2011-12-27 2013-08-08 Canon Inc 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム
US20130293550A1 (en) * 2012-05-07 2013-11-07 Business Intelligence Solutions Safe B.V. Method and system for zoom animation
JP6106967B2 (ja) * 2012-06-04 2017-04-05 ソニー株式会社 情報処理装置、情報処理方法、プログラム及び画像表示装置
WO2013186979A1 (ja) * 2012-06-11 2013-12-19 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
WO2013186995A1 (ja) * 2012-06-14 2013-12-19 ソニー株式会社 情報処理装置、情報処理方法、および情報処理プログラム
JP6014137B2 (ja) * 2012-06-29 2016-10-25 日立マクセル株式会社 表示システムおよび表示端末
JP2014038560A (ja) * 2012-08-20 2014-02-27 Canon Inc 情報処理装置、情報処理方法及びプログラム
US9396514B2 (en) 2012-08-23 2016-07-19 Pixia Corp. Method and system for storing and retrieving wide-area motion imagery frames as objects on an object storage device
JP6088787B2 (ja) * 2012-10-23 2017-03-01 任天堂株式会社 プログラム、情報処理装置、情報処理方法および情報処理システム
CN103092991B (zh) * 2013-02-08 2016-09-07 宁波江丰生物信息技术有限公司 图像的信息处理方法及装置、显示方法及装置
CN103164840A (zh) * 2013-02-08 2013-06-19 宁波江丰生物信息技术有限公司 数字切片图像存储方法及装置、电子图书显示方法及装置
JP6455829B2 (ja) * 2013-04-01 2019-01-23 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
US8988344B2 (en) * 2013-06-25 2015-03-24 Microsoft Technology Licensing, Llc User interface navigation
WO2015054198A1 (en) 2013-10-07 2015-04-16 Acist Medical Systems, Inc. Systems and methods for controlled single touch zoom
US10229478B2 (en) * 2014-09-26 2019-03-12 Samsung Electronics Co., Ltd. Image processing apparatus and image processing method
US10244241B2 (en) * 2015-03-22 2019-03-26 Innova Plex, Inc. Pyramidal file structure and method of use thereof
EP3311582A4 (en) * 2015-06-17 2018-10-31 LG Electronics Inc. Display device and operating method thereof
JP6333871B2 (ja) * 2016-02-25 2018-05-30 ファナック株式会社 入力画像から検出した対象物を表示する画像処理装置
US9996311B2 (en) * 2016-03-15 2018-06-12 Roku, Inc. Efficient communication interface for casting interactively controlled visual content
KR102204596B1 (ko) * 2017-06-02 2021-01-19 삼성전자주식회사 프로세서, 이를 포함하는 이미지 프로세싱 장치 및 이미지 프로세싱 방법
JP6873830B2 (ja) 2017-06-05 2021-05-19 キヤノン株式会社 表示制御装置、その制御方法及びプログラム
US10373290B2 (en) * 2017-06-05 2019-08-06 Sap Se Zoomable digital images
CN112684966B (zh) * 2017-12-13 2024-10-15 创新先进技术有限公司 一种图片缩放方法、装置以及电子设备
CN108363527A (zh) * 2018-02-12 2018-08-03 四川斐讯信息技术有限公司 一种光标控制方法及系统
JP6587078B2 (ja) * 2018-06-27 2019-10-09 ソニー株式会社 情報処理方法および情報処理装置
JP6997123B2 (ja) * 2019-02-28 2022-02-03 ファナック株式会社 情報処理装置および情報処理方法
JP6978456B2 (ja) 2019-02-28 2021-12-08 ファナック株式会社 情報処理装置および情報処理方法
JP6978457B2 (ja) 2019-02-28 2021-12-08 ファナック株式会社 情報処理装置および情報処理方法
JP2021015417A (ja) * 2019-07-11 2021-02-12 株式会社ソニー・インタラクティブエンタテインメント 画像処理装置、画像配信システム、および画像処理方法
US11265474B2 (en) * 2020-03-16 2022-03-01 Qualcomm Incorporated Zoom setting adjustment for digital cameras
CN111475079A (zh) * 2020-03-30 2020-07-31 维沃移动通信有限公司 对象管理方法及电子设备
CN111755101A (zh) * 2020-05-11 2020-10-09 贵阳叁玖互联网医疗有限公司 一种病理切片展示的方法及装置
US12443322B2 (en) * 2021-10-28 2025-10-14 Pixart Imaging Inc. Cursor control method and cursor control device which can improve cursor movement range and accuracy
CN116499449B (zh) * 2023-04-10 2025-09-16 北京透彻未来科技有限公司 一种病理图像的自动巡航定位导航系统及方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040167806A1 (en) * 2000-05-03 2004-08-26 Aperio Technologies, Inc. System and method for viewing virtual slides
US20050041044A1 (en) * 2003-08-22 2005-02-24 Gannon Aaron James System and method for changing the relative size of a displayed image
US20080204476A1 (en) * 2005-01-31 2008-08-28 Roland Wescott Montague Methods for combination tools that zoom, pan, rotate, draw, or manipulate during a drag
JP2009037250A (ja) 1997-03-03 2009-02-19 Bacus Lab Inc コンピュータ制御の顕微鏡から試料の拡大イメージを取得し再構成するための方法および装置
JP2009272841A (ja) 2008-05-03 2009-11-19 Nakayo Telecommun Inc 一斉呼出機能を有する電話システム

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5031044A (en) * 1989-04-20 1991-07-09 Rca Licensing Corporation Inset picture centering in a pix-in-pix system
US5187776A (en) * 1989-06-16 1993-02-16 International Business Machines Corp. Image editor zoom function
US5130733A (en) * 1989-11-24 1992-07-14 Minolta Camera Kabushiki Kaisha Camera having a pseudo format
JPH0527941A (ja) * 1991-07-22 1993-02-05 Hitachi Ltd 表示システム
JP3658036B2 (ja) * 1994-06-03 2005-06-08 キヤノン株式会社 画像入力システム及び画像入力システムの制御方法
US6388638B2 (en) * 1994-10-28 2002-05-14 Canon Kabushiki Kaisha Display apparatus and its control method
US6768563B1 (en) * 1995-02-24 2004-07-27 Canon Kabushiki Kaisha Image input system
US6008837A (en) * 1995-10-05 1999-12-28 Canon Kabushiki Kaisha Camera control apparatus and method
JPH1013725A (ja) * 1996-06-25 1998-01-16 Nikon Corp 情報処理装置
US6031930A (en) * 1996-08-23 2000-02-29 Bacus Research Laboratories, Inc. Method and apparatus for testing a progression of neoplasia including cancer chemoprevention testing
US6681056B1 (en) * 1999-03-30 2004-01-20 International Business Machines Corporation Method and system for digital image acquisition and continuous zoom display from multiple resolutional views using a heterogeneous image pyramid representation
JP2000293290A (ja) * 1999-04-02 2000-10-20 Fujitsu Ltd 情報処理装置、表示制御方法及び記憶媒体
JP4340358B2 (ja) * 1999-08-02 2009-10-07 富士フイルム株式会社 画像撮影装置
US6396503B1 (en) * 1999-12-31 2002-05-28 Hewlett-Packard Company Dynamic texture loading based on texture tile visibility
KR100405060B1 (ko) * 2000-08-24 2003-11-07 휴먼드림 주식회사 데이터 통신망을 통한 디지털 확대 이미지 제공방법,디지털 확대 이미지 제공장치
US6925200B2 (en) * 2000-11-22 2005-08-02 R2 Technology, Inc. Graphical user interface for display of anatomical information
CN100437832C (zh) * 2000-11-28 2008-11-26 株式会社艾德温特斯特 故障分析装置
US7161615B2 (en) * 2001-11-30 2007-01-09 Pelco System and method for tracking objects and obscuring fields of view under video surveillance
US20030210262A1 (en) * 2002-05-10 2003-11-13 Tripath Imaging, Inc. Video microscopy system and multi-view virtual slide viewer capable of simultaneously acquiring and displaying various digital views of an area of interest located on a microscopic slide
JP4026491B2 (ja) * 2002-12-13 2007-12-26 ソニー株式会社 画像信号処理装置、画像信号処理方法、並びにプログラムおよび媒体
US7133054B2 (en) * 2004-03-17 2006-11-07 Seadragon Software, Inc. Methods and apparatus for navigating an image
US20050027705A1 (en) * 2003-05-20 2005-02-03 Pasha Sadri Mapping method and system
JP4381761B2 (ja) * 2003-09-26 2009-12-09 キヤノンソフトウェア株式会社 表示制御装置および表示制御方法およびプログラムおよび記録媒体
US20050094262A1 (en) * 2003-11-05 2005-05-05 Visx, Incorporated Microscope magnification sensor
US7542050B2 (en) * 2004-03-03 2009-06-02 Virtual Iris Studios, Inc. System for delivering and enabling interactivity with images
JP4673000B2 (ja) * 2004-05-21 2011-04-20 株式会社キーエンス 蛍光顕微鏡、蛍光顕微鏡装置を使用した表示方法、蛍光顕微鏡画像表示プログラム及びコンピュータで読み取り可能な記録媒体並びに記憶した機器
US8016758B2 (en) * 2004-10-30 2011-09-13 Sonowise, Inc. User interface for medical imaging including improved pan-zoom control
US8799802B2 (en) * 2005-06-30 2014-08-05 Nokia Corporation Apparatus, method and computer program product enabling zoom function with multi-function key input that inhibits focus on a textually-responsive element
JP4510713B2 (ja) * 2005-07-21 2010-07-28 富士フイルム株式会社 デジタルカメラ
JP4573724B2 (ja) * 2005-08-01 2010-11-04 イーストマン コダック カンパニー 複数光学系を有する撮像装置
JP5129478B2 (ja) * 2006-03-24 2013-01-30 株式会社デンソーアイティーラボラトリ 画面表示装置
JP5162839B2 (ja) * 2006-03-29 2013-03-13 カシオ計算機株式会社 表示装置及びプログラム
JP4876697B2 (ja) * 2006-04-28 2012-02-15 ブラザー工業株式会社 画像処理装置および画像処理プログラム
US8081252B2 (en) * 2006-06-13 2011-12-20 Panasonic Corporation Image displaying apparatus
US8578292B2 (en) * 2006-12-14 2013-11-05 Microsoft Corporation Simultaneous document zoom and centering adjustment
KR20080061629A (ko) * 2006-12-28 2008-07-03 삼성전자주식회사 이미지센서의 중심점 최적화를 위한 촬영장치 및 그촬영제어방법
JP5029874B2 (ja) * 2006-12-28 2012-09-19 富士通株式会社 情報処理装置、情報処理方法、情報処理プログラム
JP5474283B2 (ja) * 2007-07-04 2014-04-16 パナソニック株式会社 モード切替装置
JP5361159B2 (ja) * 2007-09-06 2013-12-04 キヤノン株式会社 画像表示制御装置、その制御方法、プログラム、および記録媒体
US7948828B2 (en) * 2007-11-30 2011-05-24 Johnson Outdoors Inc. Flasher sonar device with light guide
US8194037B2 (en) * 2007-12-14 2012-06-05 Apple Inc. Centering a 3D remote controller in a media system
JP4583478B2 (ja) * 2008-06-11 2010-11-17 ルネサスエレクトロニクス株式会社 設計像と撮影像との重ね合わせ表示方法、表示装置および表示プログラム
US7933473B2 (en) * 2008-06-24 2011-04-26 Microsoft Corporation Multiple resolution image storage
KR100955949B1 (ko) * 2008-07-01 2010-05-03 삼성전기주식회사 화상데이터 처리방법 및 기록매체
JP5284013B2 (ja) * 2008-09-01 2013-09-11 キヤノン株式会社 撮像装置およびその制御方法、プログラム
JP5589366B2 (ja) * 2009-11-27 2014-09-17 ソニー株式会社 情報処理装置、情報処理方法及びそのプログラム
JP5561027B2 (ja) * 2009-11-30 2014-07-30 ソニー株式会社 情報処理装置、情報処理方法及びそのプログラム
JP5614032B2 (ja) * 2009-11-30 2014-10-29 ソニー株式会社 情報処理装置、情報処理方法及びそのプログラム
JP5734037B2 (ja) * 2011-03-15 2015-06-10 キヤノン株式会社 情報処理装置およびその制御方法およびプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009037250A (ja) 1997-03-03 2009-02-19 Bacus Lab Inc コンピュータ制御の顕微鏡から試料の拡大イメージを取得し再構成するための方法および装置
US20040167806A1 (en) * 2000-05-03 2004-08-26 Aperio Technologies, Inc. System and method for viewing virtual slides
US20050041044A1 (en) * 2003-08-22 2005-02-24 Gannon Aaron James System and method for changing the relative size of a displayed image
US20080204476A1 (en) * 2005-01-31 2008-08-28 Roland Wescott Montague Methods for combination tools that zoom, pan, rotate, draw, or manipulate during a drag
JP2009272841A (ja) 2008-05-03 2009-11-19 Nakayo Telecommun Inc 一斉呼出機能を有する電話システム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Zooming", INTERNET CITATION, 4 June 2001 (2001-06-04), XP002338343, Retrieved from the Internet <URL:http://www.glue.umd.edu/~pkd/imagine/viewer/viewer_zooming.htm> [retrieved on 20050714] *
MIKULA ET AL: "Internet-enabled high-resolution brain mapping and virtual microscopy", NEUROIMAGE, vol. 35, no. 1, 14 February 2007 (2007-02-14), ACADEMIC PRESS, ORLANDO, FL, US, pages 9 - 15, XP005907161, ISSN: 1053-8119, DOI: 10.1016/J.NEUROIMAGE.2006.11.053 *

Also Published As

Publication number Publication date
US10067658B2 (en) 2018-09-04
KR20110060820A (ko) 2011-06-08
US20110128367A1 (en) 2011-06-02
JP2011118479A (ja) 2011-06-16
US9324124B2 (en) 2016-04-26
CN102081495A (zh) 2011-06-01
US20160202888A1 (en) 2016-07-14
US20180341391A1 (en) 2018-11-29
JP5658451B2 (ja) 2015-01-28
CN102081495B (zh) 2015-01-07

Similar Documents

Publication Publication Date Title
US10067658B2 (en) Image processing apparatus, method, and computer-readable medium for controlling the display of an image
US11615503B2 (en) Information processing apparatus, method and computer-readable medium
US11342063B2 (en) Information processing apparatus, information processing method, and program
US10424046B2 (en) Information processing apparatus, method and program therefore
US20110267267A1 (en) Information processing apparatus, information processing method, and program therefor
US20170068343A1 (en) Information processing apparatus, method and computer-readable medium

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20101123

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17Q First examination report despatched

Effective date: 20130517

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20141219

R18R Application refused (corrected)

Effective date: 20141022