JP2011002930A - Image editing device, image editing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image editing device, image editing method, and program for improving the efficiency of image processing sequence determination.SOLUTION: An image editing device 100 for performing image editing through a GUI displayed on a desktop screen includes: an image data acquisition unit 214 for acquiring an image to be edited; an image display unit 216 for displaying the acquired image with a display area assigned thereto in the GUI; an image processing selection unit 218 for displaying in the GUI a selection area for selection of an image processing to be applied to the image displayed in the GUI; and an image processing execution unit 220 for, in response to registration of the image processing for the selected area by the image processing selection unit 218, applying the registered image processing to an input image for the registered image processing, and generating an output image. The image display unit 216 acquires the generated output image, generates a display area for displaying the output image in association with an image editing sequence, and displays the acquired output image in the generated display area.

Description

  The present invention relates to an image processing technique, and more particularly, to an image editing apparatus, an image editing method, and a program for efficiently determining the sequence of image processing for an image.

  A variety of image processing is possible for digital images, and so-called image processing, in which various effects are applied to the target image to process the image, is known from a variety of commercial software to free freeware. It has been. When a user wants to apply a specific effect to an image, it is common to specify the target effect from the image processing software used by the user and set various parameters that indicate the degree of application of the effect. It is an operation sequence.

  When performing the above-described operation sequence, a technique is known in which image processing software determines characteristics of an image to be processed and automatically sets parameters to recommended values. In image processing, a plurality of effects are often applied continuously to a target image.

At this time, when a plurality of effects are continuously applied to the target image, image degradation such as image degradation and color reproducibility degradation may occur unexpectedly depending on the order of effect application. However, when conventionally known image processing software applies a plurality of effects to a target image as a sequence, the determination of the sequence to which the image processing is applied is often left to the user's selection. When the effect application sequence is left to the user's selection, the user himself / herself selects the application order of the effects.
(1) It is difficult to intuitively understand in what order the effects should be applied in order for the user to obtain the target image.
(2) In the case of applying effects in the middle, for example, 5 types of effects, in order to change the type of effect to be applied third, the image processing that was canceled again after returning to the target image is applied in order of sequence. It takes time and effort.

  Among the above problems, with regard to (1), when applying a plurality of effects to the target image, the image finally obtained differs depending on the order in which each effect is applied. It is necessary to try with trial and error. Regarding (2), for example, the application of the effect is re-executed from the beginning, or the operation is canceled after canceling the operation to the effect to be changed using the undo function, and the application order of the effect stored by the user is changed. It is necessary to change and apply the subsequent effect again.

  Up to now, a method for improving the efficiency of the above-described image processing has been known. For example, in Japanese Patent No. 3890096 (Patent Document 1), even a user unfamiliar with image editing can easily edit an image. An image editing system that can do this is described. Japanese Patent Application Laid-Open No. 2004-133867 displays a result obtained by applying a plurality of image editing processes in different sequences on a display device, and allows a user to select a desired processing result.

  The image editing system described in Patent Literature 1 can improve the efficiency of sequence selection for effect application by presenting a plurality of image processing results to the user and selecting what the user thinks is most preferable. . However, in Patent Document 1, although the effect application selection is made more efficient, the parameter settings such as the type of processing, the sequence, the effect application degree, and the like are limited to those prepared in advance by the apparatus, and the user can freely select. There was a problem that the degree was narrowed.

  The present invention has been made in order to solve the above-described problems of the prior art, and the present invention is designed to enable the user to efficiently target the target image when applying a plurality of effects to the image. An object of the present invention is to provide an image editing apparatus, an image editing method, and a program that provide a result image having a visual effect.

  In the present invention, in order to solve the above-described problem, an image editing apparatus that performs image editing via a GUI displayed on a desktop screen includes an image data acquisition unit that acquires an original image to be edited, and a display area in the GUI. Image display means for assigning and displaying the acquired original image, selection area for selecting image processing to be applied to the original image displayed on the GUI, and image processing selection for displaying on the GUI image processing to be registered And image processing for generating an output image by applying the registered image processing to the registered input image of the image processing in response to registration of the image processing in the selected area by the image processing selection unit Execution means.

  The image display means acquires the generated output image, generates a display area for the output image in association with the image editing sequence, and displays the acquired output image in the generated display area. In the present invention, the image processing selecting means includes image processing changing means for changing the image processing to be registered in the selection area, and the image processing executing means receives the change instruction from the image processing selecting means and relates to the change. The registered image processing is executed in the order of the sequence and transferred to the image display means, and the display image of the display area generated before the change in the sequence is updated.

  Further, in the present invention, the image processing selection unit includes an image processing deletion unit that deletes the registered image processing registered in the selection area, and the image processing execution unit receives a deletion instruction from the image processing selection unit, Registered image processing that remains in the sequence and that is related to deletion is executed in order of the sequence and passed to the image display means, and the output image of the display area that was generated before the change in the sequence is updated.

  In the present invention, the image processing selection means includes image processing replacement means for changing the sequence order of the already registered image processing in the selected area, and the image processing execution means receives the instruction from the image processing selection means, and The registered image processing relating to the sequence can be executed in the order after the replacement, and the output image can be transferred to the image display means, and the image in the display area generated before the replacement can be updated with the output image. .

  The image processing selection unit includes a parameter changing unit that changes a parameter of the already registered image processing of the selection area, and the image processing execution unit detects a parameter change from the parameter changing unit, and uses the changed parameter to change the parameter The registered image processing related to the change in the sequence can be executed in the order of the sequence, and the output image of the display area generated before the parameter change in the sequence can be updated.

  Furthermore, the image editing apparatus includes a processing log recording unit that records an image processing history, and the processing log recording unit changes into a sequence by adding a new image processing, changing or deleting a registered image processing, or changing a parameter. If there is, an identification value that uniquely identifies a new image generated by the sequence change can be added and registered as a process log.

Furthermore, the present invention is an image editing method executed by a computer,
Acquiring an original image to be edited, assigning a display area to the GUI and displaying the acquired original image;
Displaying a selection area for selecting an image process to be applied to an original image displayed on the GUI and an image process to be registered on the GUI;
In response to registration of image processing in the selected region, applying the registered image processing to the registered image processing input image to generate an output image;
An image editing method for acquiring the generated output image, generating a display area for the output image in association with an image editing sequence, and displaying the acquired output image in the generated display area Is provided.

  In the present invention, when there is no image processing registered in the selected area, the image processing is added to the selected area. When the image processing is registered, the registered image processing is changed, deleted, or imaged. Displaying a GUI that allows a parameter change to be applied by the process, and can include adding, changing, deleting, or changing the parameter of image processing.

  The present invention can further include a step of replacing the sequence by changing the image processing at a specified position in the sequence.

  The present invention can further provide a computer-executable program for functioning as the above-described functional means and a computer-readable recording medium storing the program.

  According to the present invention, in order to obtain a result image intended by a user, the purpose is to confirm in real time the sequence for applying image processing efficiently and the degree of image processing while confirming the effect of image processing. It is possible to determine an image processing sequence without being limited by the type of image processing for obtaining a result image. Further, according to the present invention, the user can arbitrarily change the order and parameters in which image processing is applied while sufficiently adapting to the user's purpose. In addition, it is possible to grasp how the result image changes by applying a plurality of image processing, and to determine the necessity of applying the effect and to obtain the desired result image Can be determined efficiently.

1 is a diagram illustrating a hardware configuration of an image editing apparatus 100 according to the present embodiment. Functional block diagram of the image editing apparatus 100 of the present embodiment The figure which showed embodiment of GUI which the image editing apparatus 100 of this embodiment displays on a desktop screen. 4 is a flowchart of processing executed by the image editing apparatus 100 via the GUI of FIG. 3. The figure which showed the input / output data flow corresponding to the addition of a process, a change, and deletion in detail with reference to FIG. The figure which showed exemplary embodiment of the process log which the image editing apparatus 100 of this embodiment produces | generates and manages. FIG. 5 is a flowchart of processing subsequent to point A in FIG. 4 of processing executed by the image editing apparatus 100 when adding, correcting, and deleting processing in the present embodiment. The figure which showed embodiment of the window 800 in the state which the user acquired the target image and started the process in this embodiment. The figure which showed embodiment of the window 900 displayed after the process following FIG. 8 of the image editing apparatus 100 of this embodiment. The figure which showed embodiment of the window 1000 in the case of adding a process further in this embodiment. The figure which showed other embodiment of the process addition of this embodiment. The flowchart of the process which changes a parameter in this embodiment. The figure which showed the window 1300 displayed by embodiment of the parameter setting change by this embodiment. The figure which showed embodiment which a user sets a processing sequence, confirming an image processing history in this embodiment.

  Hereinafter, the present invention will be described with reference to embodiments shown in the drawings, but the present invention is not limited to the embodiments described below. FIG. 1 shows a hardware configuration of the image editing apparatus 100 of the present embodiment. The image editing apparatus 100 can be configured as a personal computer, a workstation, a server, or the like. The image editing apparatus 100 includes a central processing unit (CPU) 110 and a memory 112 formed from a solid-state memory element such as a RAM or a DRAM that enables processing by the CPU 110. The CUP 110 and the memory 112 are connected to other devices and drivers of the image editing apparatus 100 via the system bus 120. A graphics driver 114 and a network device (NIC) 116 are connected to the system bus 120. The graphics driver 114 is connected to the display device 118 via a bus, and displays the processing result by the CPU 110 on the display screen. The network device 116 connects the image editing apparatus 100 to the network at the transport layer level and the physical layer level, and enables data transmission / reception via the network.

  An I / O bus bridge 122 is further connected to the system bus 120. On the downstream side of the I / O bus bridge 122, an external storage device 124 such as a hard disk or various optical disks is connected by an IDE, ATA, ATAPI, SATA, SCSI, USB, etc. via an I / O bus 128 such as PCI. Is connected. Further, an input device 126 such as a keyboard and a mouse is connected to the I / O bus 128 via a bus such as a USB, and accepts input and commands by the user.

  More specifically, examples of the CPU 110 include PENTIUM (registered trademark) to PENTIUM (registered trademark) 4, a PENTIUM (registered trademark) compatible CPU, POWERPC (registered trademark), MIPS, and the like.

  As an operating system (OS) used by the image editing apparatus 100, MacOS (registered trademark), Windows (registered trademark), Windows (registered trademark) 200X Server, UNIX (registered trademark), AIX (registered trademark), LINUX (registered trademark) or other appropriate OS, such as FreeBSD, can be mentioned. The image editing apparatus 100 is an object-oriented programming such as C, C ++, C #, Visual C ++, VisualBasic, Java (registered trademark), JavaScript (registered trademark), Perl, and Ruby on the hardware / software platform described above. An application program written in a language is executed, and the computer is caused to function as function processing means described later.

  FIG. 2 is a functional block diagram of the image editing apparatus 100 of the present embodiment. The image editing apparatus 100 includes an image file selection unit 212, an image data acquisition unit 214, and an image display unit 216 that are provided as functional units of a computer by executing an application program. The image file selection unit 212 can be configured as a graphical user interface (GUI) that displays a list of image files stored in the image storage unit 210 configured in the external storage device 124 such as a hard disk device or an optical drive. The user supports the selection of image files stored in an external storage device or the like. The image file applied in the present embodiment may have any format known so far, and examples thereof include BMP, GIF, JPEG, JPEG2000, TIFF, PNG, EMF, and PostScript (registered trademark).

  The image data acquisition unit 214 reads the image file selected by the user via the image file selection unit 212 into the memory 112 such as a RAM and sets it as processing target image data for processing by the application. Further, the image editing apparatus 100 includes an image display unit 216, an image processing selection unit 218, and an image processing execution unit 220. The image display unit 216 secures a display box that functions as a display area for displaying image data on the display screen, and displays the images to be displayed in the sequence in the corresponding display box in the sequence order. Execute. Further, the image display unit 216 receives output image data that is a result image processed by the image processing execution unit 220, and indicates a correspondence between the selected process and input image data of the process on the display screen. Thus, a new display box is generated, and the output image data is displayed inside the display box.

  The image processing selection unit 218 displays various objects for selecting a process on the display screen, and calls the image process assigned to the object in response to the selection of the object through a mouse or keyboard operation. It can be implemented as an event handler to be executed. Objects managed by the image processing selection unit 218 include a selection object that enables selection and registration of image processing, and a relationship between an image and processing, and a link object that enables addition of image processing in a specific embodiment. And so on. For each object, a user event is defined in association with the object area. Upon receiving the user event, image processing can be added, changed, deleted, replaced, and image processing parameters can be set / changed.

  The image processing execution unit 220 is a processing unit that executes selected image processing on an image, and can be implemented as an application module of the image editing apparatus 100. In another embodiment, the image editing apparatus 100 can be implemented as an independent application. In this case, the image editing apparatus 100 starts up the independent application in cooperation with each other. Image processing performed by the image editing apparatus 100 includes smoothing, contrast adjustment, resolution increase / decrease, γ correction, binarization threshold setting, brightness adjustment, and color balance adjustment for the image data acquired by the image data acquisition unit 214. Tone adjustment, color / gray scale / monochrome binary adjustment, and the like, but are not limited to these processes.

  The image editing apparatus 100 further includes a processing log recording unit 222. The processing log recording unit 222 associates the processing command received by the image processing selection unit 218 with the input image data and output image data of the processing, and a processing sequence. Record as. The input image data and the output image data created by the image processing execution unit 220 are stored in the image storage unit 210 as a format designated by the user or an original format, and are used by the user for other purposes.

  The process log recording unit 222 can create a process history in various formats, and can generate a process log as a table or a list, for example. In still another embodiment, the processing log can be created as a document including ASCII code such as text, HTML, XML, etc. in consideration of interface properties with a text editor, JavaScript (registered trademark), or the like.

  FIG. 3 shows an embodiment of a GUI displayed on the desktop screen by the image editing apparatus 100 of the present embodiment. In the embodiment shown in FIG. 3, a window 300 is displayed on the desktop screen, and an image related to processing is displayed in the window 300. For example, the image selected by the user is input image data for subsequent image processing, and is displayed as an image 310 in the display box 312. The image 310 can display the target image as long as the target image can be displayed as it is, or can be displayed by appropriately reducing it to a size that can be displayed in the display box 312. In other embodiments, thumbnails can be generated and displayed in the display box 312 using, for example, EMF. A selection object 314 is displayed from the display box 312 via a link indicating that image processing can be performed on the image 310.

  A display box 316 is further displayed from the selection object 314 via a link, and an image 318 after the processing selected by the selection object 314 is displayed inside the display box 316. In the sequence to be described, the selection object 314 indicates that smoothing is selected as the image processing, and the image 318 displayed in the display box 316 is subjected to the smoothing processing on the image 310. It is a later image.

  The selection object 314 shown in FIG. 3 functions as a selection area for registering the image processing according to the present embodiment, and the shape of the selection object 314 is not limited to that shown in FIG. There is no particular limitation. The link is associated with a link object, and the shape of the link object is not particularly limited as long as it can visually indicate the image processing sequence. A function for displaying a pop-up menu is defined for the selected object and the link described above, and registration of image processing and setting of parameters of each function are possible from the selected object.

  Further, a link indicating that the subsequent image processing is possible is displayed from the display box 316 so as to point to the selected object 320. When the user desires to perform further image processing on the image 318, for example, when “sharpening” processing is registered for the selected object 320, the sharpening processing is executed using the image 318 as an input image. . Then, the generated output image is sent to the image display unit 216 in FIG. 2, and the sharpened output image is displayed as an image 324 in the newly generated display box 322. From the newly displayed display box 322, a link indicating that further image processing can be performed is displayed so as to point to another selected object 326. When the user registers specific processing such as “hue correction” processing for the selected object 326, a new display box 328 is generated, and the hue-corrected image 330 of the image processing registered in the display box 328 is created. Is displayed.

  From the newly generated display box 328, a link indicating that further subsequent image processing can be set points to a selection object 332 that enables selection of subsequent processing. If the user is not satisfied with the output image displayed in the display box 322, the target image desired by the user is generated by repeating the same processing as described above for the image 318 and the image 324.

  The input image and the output image to the processing shown in FIG. 3 are digital data, respectively, a unique identification value is assigned and stored in a RAM or the like, and is used as an input image for the subsequent editing processing. The sequence of image processing shown in FIG. 3 is, for example, {(processing 1, identification value of input image data, identification value of output image data)-(processing 2, identification value of input image data, identification of output image data). Value)-(processing 3, identification value of input image data, identification value of output image data),. . . ,} Is recorded as a process log in a RAM or the like in a format that allows the process log recording unit 222 to refer to the process sequence order as a text or structured document. Further, when the user applies a plurality of processing sequences to a specific image, the processing log can be generated in a format in which the plurality of processing sequences can be individually referred to.

  FIG. 4 shows a flowchart of processing executed by the image editing apparatus 100 via the GUI of FIG. The processing in FIG. 4 starts from step S400. In step S401, it is determined whether or not a processing object has been selected, and a user event defined for the selected object is received from the processing object via a mouse or the like (no). ), Wait for user event. When a defined user event is detected in step S401 (yes), the menu assigned to the processing object is displayed as a pull-down menu and a pop-up menu in step S402. In steps S403, S404, and S405, it is determined whether the user has selected a menu item. In the embodiment to be described, it is assumed that, as menu items, processing addition, processing change, processing deletion, and parameter setting are registered as default items.

  If it is determined in step S403 that the process addition has been selected (yes), a process list window is displayed at an appropriate position in the window 300 in step S408. The process list window can be provided as a subwindow that lists image processes that can be selected by the user and registered in the selected object. It waits for a user event until there is a user event in step S409 (no). When a user event is detected in step S409 (yes), the selected process is registered in the process object pointed to by the link extending from the last display box of the process sequence in step S410, and the registered process name is selected in the selected object. For example, “smoothing” is displayed as text, smoothing processing is immediately executed, and control is passed to processing subsequent to point A.

  On the other hand, if it is determined in step S403 that the selected menu item is not a process addition (no), it is determined whether or not the menu item selected in step S404 is a process change. If it is determined in step S404 that process change has been selected (yes), the image editing apparatus 100 branches the process to step S408, and prompts the user to select a target process to be changed in step S409. Thereafter, the same processing as that after step S409 is executed.

  On the other hand, if it is determined in step S404 that the process is not a change (no), it is determined whether or not the menu item selected in step S405 is a process deletion. If the process is not a process deletion (no), step S406 is performed. Then, it is determined whether or not the user event specifying the menu display is continued in the area of the selected object. If the user event is continued (yes), the process returns to step S403 to repeat the user event. stand by. On the other hand, if the user event does not continue (no), the process selection sequence is terminated in step S407.

  On the other hand, if it is determined in step S405 that process deletion has been selected (yes), the selected object selected in step S411 is deleted from the window 300, and in step S412, the display box and image corresponding to the process are displayed in the window. Delete from 300. Furthermore, when the subsequent process is already set in step S413 (yes), the subsequent output image is set as the input image for the image process immediately after the deleted image process in the sequence, and the output image immediately before the deleted image process is set. Apply image processing. If no subsequent process is registered in step S413 (no), the process branches to step S407, and the sequence editing process ends.

  The sequence change that can be performed in this embodiment includes addition, change, and deletion of the processing described in FIG. 4, addition of a new image processing in the middle of the sequence, deletion of registered image processing, or before and after the link object. The sequence is changed by changing the registered image processing to be exchanged with each other. Insertion of a new image process in the middle of the sequence is performed by registering the process for the selected object or link object. The deletion of the image processing in the middle of the sequence can be executed according to the processing subsequent to step S405 in FIG. The replacement will be described in more detail with reference to FIGS. 5 and 6. It should be noted that other objects that collectively execute addition, change, deletion, and processing of linked image processing across sequence link objects can be prepared as sequence replacement means. The sequence replacement unit can implement the batch selection and replacement of a plurality of images as a replacement object that continuously applies the change of the registered image processing of the selected object.

  Also, the process change is to change the process already set for the selected object to a different process, and change the input image on the sequence series in response to the selection of the menu item and the selection from the process list window. Without calling the image processing module executed by the image processing execution unit 220 by setting the argument for designating the image processing registered in the selected object to the value of the newly selected and registered different image processing. This is a process to change the argument of.

  The input / output data flow corresponding to the addition, change, and deletion of processing will be described in more detail with reference to FIG. A sequence 500 in FIG. 5 is an embodiment of a sequence in which the user performs image processing without adding, changing, or deleting the processing. In the sequence 500, the image processing apparatus 100 determines that the new sequence has started, attaches the pointer “: INIT”, and starts generating a processing log. The user selects image 0 as an initial input image (original image), registers process 1 as a selected object in accordance with the GUI described in FIG. 3, and applies process 1 to generate image 1. In the process 2, the process 2 module called in response to the registration of the process 2 to the selected object applies the process 2 to the image 1 that is the output image of the process 1, and generates the image 2 as the output image. The same process is repeated for process 3, and the process is added until the user determines that the target image has been obtained.

  When the user generates the sequence 500, the image editing apparatus 100 refers to the processing log to determine whether the image processing related to the addition is the final image processing of the current sequence. When the subsequent image processing is not registered, the processing log is extended while maintaining the pointer “: INIT” indicating the new sequence. In this embodiment, since the sequence generation is entrusted to the user, the user may delete or change the last image processing of the sequence in the final processing, but if the final processing of the sequence is deleted, (1) When the desired effect is not obtained at all, it often occurs in the process of trial and error of processing such as (2) processing selection mistake. For this reason, when the last image processing of the sequence 500 is deleted, the image editing apparatus 100 does not generate a new pointer corresponding to the deletion / change, and performs another sequence for the addition / change of the last image processing. Without definition, the sequence can be grown as indicated by the arrow in sequence 500.

  In addition, when registering as a processing log including the trial and error-like deletion / change of the last image processing in the above-described sequence, identification indicating that the processing has been deleted and changed in the new sequence By attaching values separately and explicitly indicating the processes that are alive in the new sequence, it is possible to generate a process log that controls display / non-display.

  On the other hand, the sequence 510 is an embodiment when the user changes the process 2 in the middle of the sequence to the process M. The user initially performs process 1, process 2, process 3,. . . However, it is determined that the target image cannot be obtained, and the process 2 is changed to the process M. In sequence 510, the image processing execution unit 220 corresponds to the change, and the input image after the process 2 is changed. Therefore, the image process for acquiring the argument for calling the image processing module and executing the process M is performed. Call the module. The image processing module reads the output image of process 1 that is the immediately preceding image process, performs image processing, and generates an image 2M as the output image. Thereafter, the image 2M is passed as the input image of the subsequent process 3, and the image 3M is generated as the output image of the process 3.

  The processing log corresponds to the change of the sequence 510, reads the processing log of the processing sequence 500, copies 500 to the new sequence, and attaches the pointer “: ALT” to specify the processing change, for example, and adds the sequence 510. Start changing. When the image processing selection unit 218 determines that a change instruction has been received, the image processing selection unit 218 searches for an argument that specifies image processing, and rewrites the argument with the changed argument. Thereafter, the image processing execution unit 220 calls the process M, sets the output image of the previous image process on the sequence as the input image, applies the process M, and generates the output image of the process M as the image 2M.

  Further, the image processing execution unit 220 attaches an identification value that uniquely identifies the output image on the sequence, and sets it in the processing log as an output image of the processing M. After the processing is completed, the image 2M is used as an input image of the subsequent processing 3 in the sequence, and a sequential identification 510 is assigned with unique identification values for the input image identification value and the output image identification value of the subsequent processing. Process log is generated. The generated processing log is added with a pointer such as “: ALT” and added after the processing log corresponding to the sequence 500 to update the processing log. In another embodiment, a new sequence name corresponding to the pointer “: ALT” can be added and registered as another processing log.

  The sequence 520 is an embodiment in the case where a process N that is a new process is added to the existing sequence 500. When the process N is added in the sequence 520, the output image of the immediately preceding process is set as the input image of the process N on the sequence, and the output image data of the process N is set as the input image of the process 2 on the immediately downstream side. Then, process 2 is executed. Thereafter, the processes after process 3 are executed while updating the input image and the output image and adding a unique identification value to each. On the process log, when a user event for instructing process insertion is received, the immediately preceding process log is copied, a new sequence is declared with a pointer such as “: INST”, and the image to be inserted An argument corresponding to the process N is described at a position on the process sequence, and the input image is set as an output image of the immediately preceding image process of the sequence. Then, by passing the identification value of the output image of processing N as the value of the input image on the downstream side, sequential image processing can be performed and a processing log can be generated. After the process corresponding to the sequence 520 is completed, the process log is updated by adding a new sequence 520 corresponding to the addition after the existing process log.

  In addition, the sequence 530 occurs when the process 2 is deleted from the sequence when the user has doubts about the effectiveness of the process 2 even though the process 2 is performed. The processing of the sequence 530 starts by copying the sequence 500 and declaring a new sequence “: SKIP”. In order to generate the sequence 530, the image processing execution unit 220 uses the original image as the input image, executes the process 1, sets the output image of the process 1 as the input image of the process 3 instead of the process 2, and performs the process 3 Is executed. An image 30 which is an output image of the process 3 is registered in a RAM or the like with a unique identification value.

  Other processing can be performed in the same manner as the processing of sequence 510. The process log corresponding to the sequence 530 deletes the argument specifying the deleted process and the identification value of the output image, and rewrites the input image of the subsequent process with the input image of the deleted process, and the image 3O of the process 3 This can be dealt with by newly setting the identification value as the output of process 3. Further, subsequent processing can be generated by rewriting the output value of the input image data and output image data of each processing with each newly generated identification value.

  When a user event that instructs to delete the process is detected, the image editing apparatus 100 copies the immediately preceding log and generates pointers such as “: INST”, “: ALT”, “: SKIP”, and the like. Declaring a simple processing sequence, generating the processing log by executing the above-described processing, and additionally writing the information after the immediately preceding processing log ends the update of the processing log. In addition, it may be assumed that deletion of other processing occurs in the middle of the “: INST” context in which image processing is inserted. In this case, immediately before processing insertion is commanded, a new processing log is declared, and for example, processing is performed with a pointer different from a sequence including deletion already performed, for example, “: INST + SKIP”. A process log can be updated by generating a log and additionally writing it after the existing process log.

  The embodiment in which process logs are sequentially added is a form that can be preferably used when reviewing how much the process log changes depending on the type and order of image processing in the sequence. On the other hand, if it is only necessary to track the image change in the image processing stage by focusing only on the sequence currently being processed according to a specific application, a new file may be generated and registered each time a new sequence is declared. it can.

  FIG. 6 shows an exemplary embodiment of a processing log generated and managed by the image editing apparatus 100 of the present embodiment. The image processing module is assigned a unique identification value, for example, Image_proc **. For example, it may be a numeric sequence, or a unique value indicating “smoothing”, “sharpening”, “hue correction”, or the like. May be attached. Further, image_id0001 is an identification value that uniquely designates an image generated by the immediately preceding image processing. Furthermore, as a value set to “attrib =”, a value that specifies a processing parameter of the processing is registered.

  The process log shown in FIG. 6 is generated so as to form another line for each specific process for the purpose of explanation, and the process log of the image process is a process sequence in which the process for the first target image is started. The pointer “: INIT” is assigned to the processing, the pointer “: ALT @ L” is added for processing change, the pointer “: INST @ M” is added for addition, and the pointer “: SKIP @ N” is added for deletion. , Can be created by sequentially adding after the first sequence (L, M, and N are natural numbers).

  The part following "@" following the value that identifies the process specifies the specific modification among the same type of modifications, such as deletion if deleted, when multiple sequence change processes are performed on the process sequence It is a value for. In the embodiment shown in FIG. 6, attrib, which is a processing parameter when image processing is performed, is added, and a parameter changed when the user performs a specific process is registered as attrib. . For example, attrib = default indicates that the user has performed the process with the default parameter, and attrib = user1 indicates that the user has changed the parameter to the user parameter 1.

  In addition, when the user performs processing such as change, addition, and deletion on the processing sequence generated immediately before, for example, in the processing sequence 510, a pointer that is the immediately preceding processing sequence as described with reference to FIG. =: It is possible to copy the processing sequence indicated by ALT and declare a different pointer to generate a processing log. In addition, by generating and registering a processing log in the format of FIG. 6, when the user confirms the change of the image for each processing history, it is not necessary to re-execute the image processing, and the image change history is efficiently performed. And a processing sequence close to the target image can be predicted more efficiently.

  Further, in the embodiment shown in FIG. 6, IMAGE_COUNTER, which is a counter indicating the cumulative number of images generated in the sequence, is shown. IMAGE_COUNTER is a value that accumulates and counts the number of images generated by image processing that the user has registered as user events in the sequence, and even if the added image processing is deleted, the value corresponding to deletion is reduced. I don't know. In addition, when a specific process is deleted and another process is added after that, the value of IMAGE_COUNTER is further incremented by the value of IMAGE_COUNTER to specify the order of history in the sequence of the added image processing It is also possible to identify the deleted image.

  For example, the identification value that uniquely identifies the image can be Image_idINCR (INCR is the value of IMAGE_COUNTER after the increment), and uniquely identifies the image generated on each processing log in FIG. Used for The output image of the deleted image processing can be left as it is, and the output image of the image processing before the deletion and before the change according to the capacity of the RAM or the like should be deleted corresponding to the registration of the processing. Can do.

  As a result, even if the user adds, deletes, or changes a specific process many times, a newly generated image can be assigned a different image even at the same sequence position, and only a process log is designated. Thus, the corresponding images can be acquired and arranged in the processing sequence order.

  Furthermore, FIG. 6 shows an embodiment in which the process log is registered as a separate file with the sequence 510 and a new sequence declaration. When the processing log is registered as a separate file together with the declaration of the new sequence, the sequence 510 has a file name = INIT. The sequence 610 registered as log and related to the change is file name = ALT. It is registered as log etc.

  FIG. 7 is a flowchart of processing subsequent to point A in FIG. 4 of processing executed by the image editing apparatus 100 when processing is added, modified, or deleted in the present embodiment. The process in FIG. 7 is started by passing control from the point A in FIG. 4. In step S700, the image processing execution unit 220 refers to an argument of the specified process and starts an application that executes the process. The output image data of the immediately preceding process is designated as the input data, and the process is started. In step S701, a new display box is generated, and an image of the processing result is displayed in the generated display box. In step S702, it is determined whether the value of the subsequent selection object is null, it is determined whether the subsequent process is set. If the subsequent process is not set (no), from the point C, The process is branched to point C in FIG. 4 and the process is terminated.

  On the other hand, if the subsequent process has already been defined in step S702 (yes), the output image generated in the process of step S700 is set as the input image of the subsequent process in step S703, and the point B in FIG. Through point A, the point A in FIG. 7 is reached, and further subsequent processing is executed. With the processing in FIG. 7, even if the user adds, changes, or deletes any processing in the processing sequence, an image corresponding to the correction of the sequence can be efficiently presented to the user. When the user is satisfied with the target image, the target image is stored in the image storage unit 210 in an arbitrary format so that the user can use it for another purpose.

  Hereinafter, the image editing process by the image editing apparatus 100 according to the present embodiment will be described in detail with reference to FIGS. FIG. 8 shows an embodiment of the window 800 in a state where the user has acquired a target image and started processing in the present embodiment. In FIG. 8 to FIG. 11, additional button objects such as save and cancel are omitted for convenience of explanation. When the user starts processing and determines a target image, a display box 810 is displayed in the window 800, and the target image 812 is displayed in the display box 810. The target image 812 may be an appropriately reduced image or a thumbnail.

  Also, from the display box 810, a selected object 816 to which a text display = processing box is given is pointed by a link 814. The selection object 816 detects a user event such as a double click, a single click, or a right click via a mouse or the like and displays a pop-up menu 818 for prompting a process selection. The pop-up menu 818 shows menu items such as “add process”, “delete process”, “change process”, and “change parameter” for illustrative purposes.

  The selection object 816 is an object that sets an argument for image processing to be executed at the position of the selection object 816, passes it as an argument to the image processing execution unit 220, and allows the user to call an image processing module selected / registered. . The selection object 816 displays a name such as “processing box” as shown in FIG. 8 when the variable appl_name = null, which is a processing argument, is displayed in the selection object 816. After the image processing is defined, for example, Displays text that digests processing such as hue correction.

  When the user performs a user event defined for the selected object 816 in the window 800 of FIG. 8, the image editing apparatus 100 displays a pop-up menu 818 on the window 800. In the pop-up menu 818, only the “add processing” option menu 820 for registering image processing at the position of the selected object 816 can be selected at the stage of FIG. The other option menus are grayed out because an argument for specifying image processing is not currently defined for the selected object, and are not selectable as viewed from the user. When the user selects the “add process” option menu 820, a process list window that allows image processing to be added is displayed, and an image processing module can be selected.

  FIG. 9 is an embodiment of a window 900 that is displayed after the processing subsequent to FIG. 8 of the image editing apparatus 100 of the present embodiment. When the user instructs the image editing apparatus 100 to add a process from the selected object 816, a process list window 920 is displayed. In the processing list window 920, image processing types that can be executed by the image editing apparatus 100 are displayed as an object 922 for analogizing the selected object 816. The user aligns the mouse 924 with the object 922 displayed as smoothed from the process list window 920 and drags and drops it on the selected object 910, so that an argument assigned to the object 922 and calling the corresponding image process is Registered in the selection object 910 as appl_name = flat.exe or the like.

  When the selection object 910 detects that the argument for calling the image processing is not null, the selection object 910 passes the argument set to the image processing execution unit 220 and activates the corresponding application module. For example, when the argument is set as appl_name = image_proc01 and the input image data is source, the image processing execution unit 220 receives the argument and executes the execution code <appl_code.exe “D: \ source”> The processing result is stored in the RAM as image_id0001 or the like. When the image display unit 216 receives a notification that the processing of the image processing execution unit 220 is finished, the image display unit 216 generates a display box 914, reads out the output image of the image processing from the RAM or the like, and displays it in the display box 914. Note that the image processing option shown in FIG. 10 is merely an example, and in the present embodiment, any image processing module mounted on the image editing apparatus 100 can be used without limitation.

  FIG. 10 is an embodiment in the case where processing is further added in the present embodiment. In the window 1000 shown in FIG. 10, as described in the embodiment of FIG. 9, processing = smoothing is set for the selected object 910, and the image processing execution unit 220 executes image processing and outputs output image data. The generated image 916 is displayed in the display box 914. In the embodiment to be described, it is assumed that the identification value that uniquely designates the image 916 is image_id0001.

  When the processing of the image processing execution unit 220 is further completed, a new selected object 1010 pointed to by the link is displayed from the display box 914. The user can add subsequent image processing by matching the mouse to the newly displayed selection object 1010 and generating a defined user event. The added image processing can be, for example, “sharpening” in the processing list window 920. By dragging and dropping the object 1016 onto the selection object 1010, appl_name = image_proc02 is set in the selection object 1010. The image processing execution unit 220 executes the execution code <imageproc02.exe “image_id0001”> to generate the output image image_id0002, and then stores the output image in the RAM. Then, the image display unit 216 is notified, a new display box 1018 is generated, and an image 1020 referred to by image_id0002 is displayed therein. By repeating the above processing, the user can acquire the result of performing specific image processing on the target image continuously.

  FIG. 11 shows an embodiment of a sequence change process classified as another embodiment of the process addition of this embodiment. The embodiment shown in FIG. 11 is a sequence change by replacing an image process in the sequence change process. The embodiment shown in FIG. 11 is an embodiment of a process for generating the processing sequence 510 of FIG. An original image 1112 is displayed in the display box 1110. The user has already applied smoothing processing to the original image 1112 in the window 1100 shown in FIG. 11, and is shown in the window 900 shown in FIG. It shall be in the state.

  It is assumed that the user is not satisfied with the image 916 obtained by performing the smoothing process on the original image 1112 and wonders how to perform the sharpening process before the smoothing process. In this case, the user matches the mouse cursor to the link 814 that points to the selected object 910 in FIG. 9 or the selected object 910 that has already been registered with the “smoothing” process, and clicks a defined user event, such as a right mouse click. Generate. Then, a pop-up menu is displayed, and when a process addition is selected, a process list window 1130 is displayed.

  The user aligns the mouse cursor on the sharpening object 1134 and drags and drops it on the link 1132 or the selection object 1118, allowing the user to add image processing to an intermediate position in the sequence. In this case, the position of the process sequence to which the process is added is set immediately before the smoothing process, which is the process sequence on the GUI where the user event has occurred. The window 1100 shown in FIG. 11 is generated when the user performs the above-described processing on the window 800 shown in FIG.

  For example, the user drags and drops the sharpened object 1134 onto the link 1132. When the link object defined in the link 1132 detects a drag-drop user event, it determines whether or not the argument appl_name = null for calling the image processing of the object related to the user event, and is not null In the sequence, image processing is added before the image processing defined immediately after the position in the sequence, appl_name = image_proc003 is set, and the original image 1112 is set as the input image of the added image processing. And immediately execute the image processing. Then, the output image obtained as a result of the execution is passed as an input image for the already defined smoothing process, and the smoothing process is executed.

  As a result, the user can obtain an image 1122 obtained by executing the sharpening 1118 process instead of the smoothing 1116 at the position on the processing sequence where the smoothing process has been defined for the original image 1112. Further, the image processing execution unit 220 executes the already defined smoothing process 1124 on the image 1122 that is the result of executing the sharpening process, and the display box 1126 has been smoothed after the sharpening process. An image 1128 is displayed. As described above, the image data generated by changing the processing sequence is given a unique identification value and registered in the RAM or the like.

  In addition, about the change and deletion of a process, the change of a process sequence can be each commanded by making the position of the user event which displays a pop-up menu into the selection object 1118.

  Further, the image editing apparatus 100 according to the present embodiment corrects the parameters of image processing included in the processing sequence without changing the processing sequence, and also generates a sequence of image data corresponding to the parameter correction. A GUI that allows parameter changes can be prepared separately from the addition, deletion, and modification of processes, but it is possible to increase the number of program modules by setting them as pop-up menu items for addition, modification, and deletion. It is preferable in terms of usability and without accompanying.

  As shown in FIGS. 8 and 10, the parameter change menu is added to the pop-up menu 818. When a user event occurs on a selected object for which processing has already been defined, an argument for specifying the processing Is detected to be non-null, the display is changed from gray display to black display, and the parameter can be changed.

  When the user selects a parameter change menu, a parameter or a list of parameters that can be set in the corresponding process is displayed, and the image processing parameter of the process selected by the user can be changed. The parameter changed by the user is set in, for example, the attrib variable of the processing log.

  FIG. 12 is a flowchart of processing for changing parameters in the present embodiment. The process in FIG. 12 starts from a state of waiting for a user event in step S1200. In step S1201, it is determined whether a user event for instructing parameter setting has occurred on a selected object for which processing has already been set. If no user event for requesting parameter setting occurs (no), in step S1201 stand by.

  If a user event requesting parameter operation occurs in step S1201 (yes), a GUI for performing parameter setting is displayed on the window in step S1202. In step S1203, the currently processed parameter value currently registered is compared with the parameter value set at that time from the GUI to check the parameter setting value change. If it is determined in step S1203 that the parameter setting has been changed (yes), the processing parameter is changed in step S1204, control is transferred from point A to point A in FIG. 7, the image processing execution unit 220 is called, and the subsequent sequence The image processing is executed in this order. On the other hand, if there is no parameter change (no), control is passed from point C in FIG. 12 to point C in FIG. 4 to end image editing.

  The determination that there is no parameter change can be made using any method known so far. For example, a timeout is set in the GUI display of the parameter setting, and no parameter change is made due to the expiration of the timeout timer. Judgment can be made.

  FIG. 13 shows a window 1300 displayed in the parameter setting change embodiment according to this embodiment. In the embodiment shown in FIG. 13, the target image 1312 is displayed in the display box 1310 and the image after smoothing is displayed in the display box 1314. The image displayed in the display box 1314 is: When the image processing execution unit 220 executes the processing, the image processing execution unit 220 is generated using default parameter values. When the user generates a user event on the selected object 1330, a pop-up menu 1316 is displayed. In the embodiment of FIG. 13, since a significant argument is designated for the selection object 1330, the parameter item is displayed in black on the pop-up menu 1316. At this stage, the user can specify parameter changes.

  When the user selects parameter change, a GUI for changing the parameter, in the embodiment to be described, for example, a slider bar 1320 for correcting the edge cutoff level is displayed. When the image editing apparatus 100 determines that the user has corrected the parameter value from the slider bar 1320, the change in the parameter is reflected in the smoothed image processing, and the image in the display box 1314 is changed to the image shown in the display box 1322. And changed. If the user is not satisfied with the parameter change, the user further operates the slider bar 1324 to change the parameter value to generate an image displayed in the display box 1326 in the display box 1314.

  In another embodiment, the original image is not replaced with the image corresponding to the parameter change, but is listed as shown in FIG. 13 and the user event is detected by selecting one of the display boxes 1322 and 1326. Can be reflected in the image of the display box 1314. In the case of this embodiment, the attrib variable is rewritten in the processing log with the parameters when the image in the selected display box is generated. In the present embodiment, the settable parameters include the edge cut-off level, gradation level, color balance, hue, monochrome / grayscale / color mode designation, compression level, resolution, dithering method (random dither or pattern dither). ), Luminance dynamic range, contrast, and the like can be exemplified, but are not limited to these parameters.

  FIG. 14 shows an embodiment in which the user sets the processing sequence while checking the image processing history in this embodiment. In the window 1400 of FIG. 14, a processing history is displayed together with an image for each processing step in the processing sequence commanded by the user. In the processing stage 1410, an image corresponding to the selection of the target image is displayed. In the processing stage 1420, an image and a target image when the user performs a smoothing process on the target image are displayed.

  Further, at the processing stage 1430, the user adds a sharpening process after smoothing, and the image after the sharpening process is displayed on the rightmost side. By performing the history display of FIG. 14, the user can perform a series of predictions regarding changes in image characteristics, and can efficiently add, change, and delete processes. The processing stage 1440 is a display frame that extracts and displays input image data, processing content, and output image data of the latest image processing.

  For example, the user can add a new process within a display frame that displays the current process result. In this case, a new process is performed using the processes described with reference to FIGS. 9, 10, and 11. Image processing can be added or modified. When the processing sequence is modified in the display frame displaying the current processing result, the latest all processing sequence is displayed in the processing stage 1430. When the size of the display frame is insufficient, the cursor moves to hide the image of the processing stage 1410, and instead, the latest entire processing sequence can be displayed.

  The GUI shown in FIG. 14 can be generated using the processing log 600 described in FIG. 6, and each processing stage starts reading from the first line of the processing log, and the target image is displayed in the first stage. Image and object corresponding to the processing contents of the first row are displayed on the second stage, and images and objects corresponding to the processing contents of the first and second rows are displayed on the third stage. Can be generated sequentially. The current processing result can be generated by reading the description of the last line of the processing log 600 and displaying the corresponding image and object. In the present embodiment, it is also possible to copy the processing sequence displayed in the history and change the image processing or the parameter setting for the copied processing sequence. For example, in the described embodiment, generating a predefined user event such as a double click on the processing stage 1420 GUI of FIG. 14 causes the processing stage 1420 to be copied and displayed at the appropriate location in the display frame. In the copy sequence, the corresponding part of the processing log in FIG. 6 is also copied and, for example, a new sequence is declared with a pointer “: CPOY”. When the user applies the same operation as described in FIGS. 9 to 11 to the object at the processing stage corresponding to the copy sequence, a sequence cut out from the middle of the processing sequence is used as an initial sequence, Can be corrected.

  When the user determines that the finally generated image is acceptable as the target image, the user points the mouse cursor at the finally generated image and generates a user event such as a right mouse click. By displaying a pop-up window including a file saving menu item and selecting file saving, the final image can be registered in the image storage unit 210 as a target image.

  Further, for the intermediately obtained image shown in FIG. 14, a unique identification value such as image_id000N (N is a natural number) is attached to the RAM or the like until a series of image processing sequences is completed. Is held. When it is necessary for the user to compare which is preferable as the target image, or when it is desired to store the processing log itself, only a specific intermediate image can be recorded in the image storage unit 210. When the user records the process log itself, the process log 600 and the corresponding image can be associated with each other and stored in the external storage device 124 such as a hard disk device or an optical drive. Further, when the processing log 600 is recorded, an identification value for uniquely identifying an image is replaced with a variable and registered as a macro object, and a processing sequence registered simply by designating a target image in subsequent processing is performed. It is possible to automatically execute and generate a target image subjected to the same processing.

  By registering the processing log 600 as a macro object, it is possible to improve the efficiency of processing for performing the same image processing on a large number of processed images, and there is no variation in image processing due to user preferences, so that a higher-precision image can be obtained. Processing can be executed efficiently.

  The above functions of this embodiment are object-oriented programming languages such as Visual Basic, C, C #, C ++, Java (registered trademark), Java Beans (registered trademark), Java Applet (registered trademark), JavaScript (registered trademark), Perl, and Ruby. It can be realized by a device executable application program or plug-in program described in the above, and the program is stored in a device-readable recording medium such as a hard disk device, CD-ROM, MO, flexible disk, EEPROM, EPROM and distributed. And can be transmitted over the network in a format that other devices can.

  Although the present embodiment has been described so far, the present invention is not limited to the above-described embodiment, and other embodiments, additions, changes, deletions, and the like can be conceived by those skilled in the art. It can be changed, and any aspect is within the scope of the present invention as long as the effects and effects of the present invention are exhibited.

DESCRIPTION OF SYMBOLS 100 ... Image editing apparatus 110 ... CPU, 112 ... Memory, 120 ... System bus, 114 ... Graphics driver, 118 ... Display apparatus, 116 ... Network device, 122 ... Bus bridge, 128 ... Bus, 124 ... Storage device, 126 ... Input device 200 ... Function block (image editing apparatus) 212 ... Image file selection unit 214 ... Image data acquisition unit 216 ... Image display unit 210 ... Image storage unit 218 ... Image processing selection unit 220 ... Image Processing execution unit, 222 ... processing log recording unit, 300 ... window, 312 ... display box, 310 ... image, 314 ... selected object, 316 ... display box, 318 ... image, 320 ... selected object, 322 ... display box, 324 ... Image, 326 ... selected object, 328 ... display box 330 ... image, 332 ... selected object

Japanese Patent No. 3890096

Claims (11)

An image editing apparatus that performs image editing via a GUI displayed on a desktop screen, wherein the image editing apparatus includes:
Image data acquisition means for acquiring an original image to be edited;
Image display means for allocating a display area to the GUI and displaying the acquired original image;
A selection area for selecting image processing to be applied to the original image displayed on the GUI, and an image processing selection means for displaying the image processing to be registered on the GUI;
In response to registration of the image processing in the selected area by the image processing selection means, image processing execution for generating an output image by applying the registered image processing to the registered input image of the image processing Means,
Including
The image display means acquires the generated output image, generates a display area for the output image in association with the image editing sequence, and displays the acquired output image in the generated display area An image editing device.   The image processing selecting means includes image processing changing means for changing an image processing to be registered in the selection area, and the image processing executing means receives a change instruction from the image processing selecting means and relates to the change. The image editing apparatus according to claim 1, wherein registered image processing is executed in the order of the sequence and transferred to the image display unit, and the display image of the display area generated before the change in the sequence is updated.   The image processing selection unit includes an image processing deletion unit that deletes the registered image processing registered in the selection area, and the image processing execution unit receives a deletion instruction from the image processing selection unit, and The registered image processing that remains in the sequence and that is related to deletion is executed in the order of the sequence and passed to the image display means, and the output image of the display area that was generated before the change in the sequence is updated. The image editing apparatus according to claim 1.   The image processing selection means includes image processing replacement means for changing the sequence order of registered image processing of the selected area, and the image processing execution means receives an instruction from the image processing selection means and performs the replacement. The related registered image processing is executed in the order after replacement of the sequence, the output image is transferred to the image display means, and the image of the display area generated before replacement in the sequence is updated with the output image. The image editing apparatus according to claim 1.   The image processing selection unit includes a parameter changing unit that changes a parameter of the registered image processing in the selection area, and the image processing execution unit detects a change in the parameter from the parameter changing unit, and The registered image processing related to the change of the parameter is executed using the parameter in the order of the sequence, and the output image of the display area generated before the parameter change is updated in the sequence. 5. The image editing device according to any one of to 4.   The image editing apparatus includes a processing log recording unit that records a history of the image processing, and the processing log recording unit performs the sequence by adding a new image process, changing or deleting a registered image process, or changing a parameter. If there is a change in the sequence, a new image generated by the change in the sequence is added with an identification value that uniquely identifies the sequence, and the sequence is registered as a process log. The image editing apparatus according to any one of the above. An image editing method executed by a computer, wherein the image editing method acquires an original image to be edited by the computer, assigns a display area to the GUI, and displays the acquired original image;
A selection area for selecting an image process to be applied to the original image displayed on the GUI and the image process to be registered are displayed on the GUI;
In response to registration of image processing in the selected region, applying the registered image processing to the registered input image of the image processing to generate an output image;
Acquiring the generated output image, generating a display area for the output image in association with the image editing sequence, and displaying the acquired output image in the generated display area , Image editing method.   When there is no image processing registered in the selection area, image processing is added to the selection area, and when the image processing is registered, the registered image processing is changed, deleted, or The image editing method according to claim 7, further comprising a step of displaying a GUI that enables a parameter change applied by the image processing and enabling the addition, change, deletion, or parameter change of the image processing.   The image editing method according to claim 7, further comprising a step of replacing the sequence by changing image processing at a specified position of the sequence.   The computer executable program for functioning a computer as a function means of any one of Claims 1-6.   A computer-readable recording medium storing the program according to claim 10.