JP2009238106A - Image processing method, device and program - Google Patents

Abstract

A plurality of decorative parts are arranged in a region on a screen reflecting a user's intention by a simple cursor operation.
The movement distance and movement of a cursor between a first point on the screen where the operation for releasing the cursor has been performed and a second point on the trajectory to which the cursor has moved before the operation for releasing the cursor. Determine the length based on at least one of the times, and from the trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved prior to releasing the cursor, the trajectory An extension trajectory of the determined length extending beyond the first point is determined, and a plurality of decorative parts are arranged along the determined extension trajectory.
[Selection] Figure 4

Description

  The present invention relates to an image processing method, apparatus, and program for arranging a plurality of decorative parts in a target area displayed on an image display means based on a cursor operation.

  In recent years, in order to enjoy digital photographic images, various shapes such as flowers and heart marks have been decorated on the photographic images, and the photographic images to be decorated are displayed on the image display means. It is known that a desired decorative part is arranged at a position on a photographic image that is directly designated by a user clicking a cursor.

  In Patent Document 1, as shown in FIG. 18, a method of automatically arranging decorative parts at random positions in a background area excluding a person's face area 92 in a photographic image 91 is proposed.

Patent Document 2 proposes a method of automatically positioning and arranging decorative parts (glasses, jars, etc.) that are scaled to fit the size of the face area of a person in a photographic image so as to match the face area image. ing.
JP 2000-22929 A JP 2004-178163 A

  However, in the above-described method of arranging a decorative part at a position directly designated by the user, an operation for specifying the arrangement position is required every time a decorative part is arranged. There is a problem that it takes. In addition, when the user is unfamiliar with the positioning for arranging the decorative part, the arrangement is often unnatural.

  Moreover, in the method of patent document 1 which arranges decoration parts automatically in a random position, although it is possible to reduce a user's effort by automating arrangement of decoration parts, it is user in arrangement of decoration parts. Cannot reflect the intention of.

  Further, in Patent Document 2 in which an appropriate arrangement position of a decoration part is uniquely determined according to the position and size of the face area, there are few variations in the effect of decoration obtained by using the decoration part. There's a problem.

  In view of the above circumstances, an object of the present invention is to provide an image processing method, an apparatus, and a program capable of arranging a plurality of decorative parts reflecting a user's intention by a simple cursor operation. is there.

  An image processing method of the present invention is an image processing method in which a plurality of decorative parts are arranged in a target area displayed on an image display means based on an operation of the cursor. At least one of the moving distance and the moving time of the cursor between the first point at which the releasing operation is performed and the second point on the trajectory to which the cursor has moved before the releasing operation, or the pressing of the cursor Determine the length based on the time, and from the trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved before the operation of releasing the cursor, An extension track of the determined length extending beyond one point is determined, and a plurality of decorative parts are arranged along the determined extension track.

  An image processing apparatus of the present invention is an image processing apparatus that arranges a plurality of decorative parts in a target area displayed on an image display means based on an operation of the cursor, and the cursor on the image display means At least one of the moving distance and the moving time of the cursor between the first point at which the releasing operation is performed and the second point on the trajectory to which the cursor has moved before the releasing operation, or the pressing of the cursor From a trajectory defined based on a length determining means for determining a length based on time, a first point, and one or more points on the trajectory to which the cursor has moved prior to the operation of releasing the cursor An extended trajectory determining means for determining an extended trajectory having a length determined by the length determining means, extending beyond the first point of the trajectory; and along the extended trajectory determined by the extended trajectory determining means Arrange multiple decorative parts It is characterized in that a Kazarizuke component placement means.

  The apparatus may further include setting means for setting at least one of the number, size, and color of the decoration parts arranged by the decoration part arrangement means.

  The setting by the setting means is performed based on the duration of the operation that is maintained while the cursor is pressed on the selection button that is displayed on the image display means and that is used to select a decorative part to be arranged. It may be.

  In the above apparatus, the operation of pressing the cursor on the selection button and the operation of releasing the cursor at the first point may be performed in a series of operations.

  Further, in the above apparatus, the target region is a region where a photographic image exists, and further includes a detection unit that detects a region representing a main subject in the photographic image, and the decoration component arranging unit is detected by the detection unit. You may arrange | position a decorative component in a mutually different arrangement | positioning aspect in an area | region and another area | region.

  The determination by the length determination means may be made based on either the moving speed or the moving acceleration of the cursor between the first point and the second point.

  In addition, the second point is the point at which the cursor was pressed by a series of operations before releasing the cursor, the point at which the cursor was located a predetermined time before the operation to release the cursor, and the cursor. It may be one of the points existing at a predetermined distance from the first point on the trajectory where the cursor has moved before the releasing operation.

  The image processing program of the present invention is a program for arranging a plurality of decorative parts on the target area displayed on the image display means based on the operation of the cursor, on the computer, on the image display means, At least one of the movement distance and the movement time of the cursor between the first point where the operation for releasing the cursor was performed and the second point on the trajectory to which the cursor moved before the operation for releasing the cursor, or the cursor A path determined from the trajectory defined on the basis of the first point and one or more points on the trajectory to which the cursor has moved before the operation of releasing the cursor. Determining an extension trajectory of the determined length extending beyond the first point, and arranging a plurality of decorative parts along the determined extension trajectory.

  Note that the target area here means a wide area where a decorative part is to be placed, and is not limited to an area in which various types of images, graphics, character strings, etc. exist in addition to photographic images. It also includes areas where no exists.

  The “cursor” indicates an operation position on the screen, and is not necessarily limited to a pictorial symbol appearing on the screen. Therefore, “operating the cursor” means an input device that specifies the input position and coordinates on the display screen, such as a mouse that operates the cursor on the display screen and a remote control / pointing device using an infrared or radio system. It is not limited to moving the pictorial symbol on the screen to operate the cursor on the display screen using, but means including a touch panel that operates with a finger without appearing on the screen.

  Here, the operation of pressing the cursor, the operation of maintaining the pressed state, the operation of moving in the pressed state (drag operation), and the releasing operation are, for example, when the input device that operates the cursor is a mouse. An operation of pressing a mouse button, an operation of keeping a mouse button pressed, and an operation of releasing a mouse button. In the case of a touch panel, it means an operation of touching the panel with a finger, an operation of maintaining the touched state, an operation of moving the touched finger on the panel surface, and an operation of releasing the finger from the panel.

  Further, performing the operation of pressing the cursor and the operation of releasing the cursor by a series of operations means that the cursor is kept pressed between these operations.

  According to the image processing method and apparatus and the program of the present invention, when arranging a plurality of decorative parts based on the operation of the cursor in the target area displayed on the image display means, on the image display means, Either or both of the moving distance and moving time of the cursor between the first point at which the operation for releasing the cursor was performed and the second point on the trajectory to which the cursor moved before the operation for releasing the cursor Alternatively, the length is determined based on the time the cursor is pressed, and from a trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved prior to releasing the cursor. The extension track of the determined length extending beyond the first point of the track is determined, and a plurality of decorative parts are arranged along the determined extension track. By a simple cursor operation A plurality of components with decoration can be arranged to reflect the user's intention.

  In addition, when the extended trajectory is longer than the trajectory moved by the cursor, the decorative part can be arranged over a wide range by a cursor operation in a small range.

  Further, at least one of the number, size, and color of the decoration parts to be arranged is displayed on the image display means, and the cursor is pressed on the selection button used for selecting the decoration parts to be arranged. When setting based on the duration of the operation maintained in the state, the user can perform settings such as the number of decorative parts by intuitive cursor operation.

  In addition, when the operation of pressing the cursor on the selection button and the operation of releasing the cursor at the first point are performed in a series of operations, the decorative component can be arranged with fewer operations. it can.

  In addition, when the target area is an area where a photographic image exists, an area representing a main subject in the photographic image is detected, and decorative parts are arranged in different arrangement modes in the detected area and other areas, For example, a large number of decorative parts should not be placed on the face area that is the main subject in the human image, and a large number of decorative parts should be placed in areas other than the face. The face image can be made to stand out.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an outline of an image processing workstation. As shown in the figure, this image processing workstation is a computer that displays an input image, performs image processing according to an instruction from a user, and displays an image processed image, and inputs a digital image. An image input unit 10, a user input unit 20 for inputting an instruction from a user, an image processing unit 30 that performs image processing on a digital image based on an input in the user input unit 20, and an image display unit such as a display 40, and a display control unit 50 for displaying an input image, an image processed image, and the like on the image display unit 40.

  The user input unit 30 includes an input device for designating an input position and coordinates on the display screen, such as a mouse, a touch panel, an infrared or radio remote control / pointing device, and the like. By operating the cursor on the display screen using, the computer can execute a desired process. For example, by pressing the mouse button, moving the mouse in the pressed state, and releasing the mouse button at the destination, the operation of pressing the cursor, the operation of moving while maintaining the pressed state, and the releasing operation are performed. be able to.

  FIG. 2 is a block diagram showing a part of the image processing unit 30 related to the function of arranging a decorative part. The image processing unit 30 arranges decoration parts based on the operation of the cursor on the display screen 61 as shown in FIG. 3, for example, and the decoration part selection unit 31, the strength setting unit 32, and the length determination A section 34, an extended trajectory determination section 35, an arrangement section 36, a detection section 37, and the like.

  The configuration of the image processing unit shown in FIG. 2 is realized by executing an image processing program read into the auxiliary storage device on the image processing workstation. At this time, the image processing program is stored in an information storage medium such as a CD-ROM, or distributed via a network such as the Internet and installed in a computer.

  The decorative part selection unit 31 performs, for example, the operation of pressing the cursor on any of the decorative part selection buttons 71, 72, 73 displayed on the display screen 61 as shown in FIG. A decorative part corresponding to the selection button is selected.

  The strength setting unit 32 sets the number, size, color, etc. of the decorative parts arranged by the arrangement processing unit 34 using values set in advance by default or according to a user input, For example, a decorative part depending on the number of times the cursor is pressed on the selection button, the duration of the operation that is maintained while the cursor is pressed, the strength of the pressing pressure on the pressure-sensitive touch panel, etc. Set the number of.

  As shown in Fig. 4, the longer the duration of the operation that is held with the cursor Cs held down on the selection button, the longer the animation that the heart-shaped decoration parts increase on the display screen, and the setting is made. You may make it also the number of decoration parts to increase.

  In addition, when arranging decorative parts of various sizes with random colors, set the number of colors, the number of sizes, etc. used for the decorative parts, and the variety of decorative parts to be arranged Can also be adjusted.

  Alternatively, each setting value of a plurality of setting items may be defined in advance at a plurality of stages, and a set of setting values corresponding to a stage selected according to a user input may be used. For example, in stage 1, the number of decorative parts to be arranged is five, of which two are red, three are white, two are large, two are medium, One is set to a small size, but in stage 2, the number of decorative parts to be arranged is seven, of which two are red, three are white, two are blue, and three It is defined in advance so that the setting is made such that the size is large, 2 is medium size, and 2 is small size.

  The length determining unit 34 moves the cursor on the image display unit 40 between the point Pt at which the operation for releasing the cursor was performed and the point Ph on the trajectory to which the cursor moved before the operation for releasing the cursor. The length D is determined based on one or both of the travel time and the travel time.

  For example, any of the movement distance, movement speed, and movement acceleration of the cursor between the point Pt and the point Ph is used as a reference for determining the length, and the value of the movement distance, movement speed, or movement acceleration used as the reference is It determines so that length D becomes large, so that it is large.

  Note that the length D may be determined to increase as the elapsed time from when the cursor starts to be pressed until the cursor is released at the point Pt is longer.

  Here, as shown in FIG. 5 and FIG. 6, the point Ph is moved at the point P1 in the movement trajectory T of the cursor, moved to the point Pt while being pressed, and released at the point Pt. In this case, it may be the point P1 at which the pressing operation is started, or may be the point P2 existing at a predetermined distance from the point Pt on the trajectory on which the cursor has moved before the operation of releasing the cursor at the point Pt. Alternatively, it may be a point where the cursor is located a predetermined time before the operation of releasing the cursor at the point Pt.

  In FIG. 5 to FIG. 8, the portion of the trajectory moved with the cursor pressed is indicated by a solid line, and the portion of the trajectory moved with the cursor released is indicated by a broken line.

  The extended trajectory determination unit 38 extends from a trajectory defined based on the point Pt and one or more points on the trajectory to which the cursor has moved before the operation of releasing the cursor, beyond the point Pt of the trajectory. Determine the extension trajectory of length D. Here, the trajectory defined based on a plurality of points refers to, for example, a spline curve that smoothly passes through the plurality of points, a Bezier curve obtained using the plurality of points as control points, and the like. A trajectory defined based on two points refers to a straight line connecting those points.

  For example, as shown in FIG. 5 and FIG. 6, a long line extending beyond the point Pt from a line segment R1 connecting the point P1 at which the cursor pressing operation is started and the point Pt at which the pressed cursor is released is connected. A straight line E1 having a length D is determined as an extended trajectory. In addition, it extends beyond the point Pt from the line segment R2 that connects the point Pt and the point P2 that exists at a predetermined distance from the point Pt on the trajectory where the cursor has moved before releasing the cursor at the point Pt. Alternatively, the straight line E2 having the length D may be determined as the extension trajectory, or a line connecting the point Pt and the point where the cursor was located a predetermined time before the operation of releasing the cursor at the point Pt. Therefore, a straight line having a length D extending beyond the point Pt may be determined as the extended trajectory.

  Further, as shown in FIGS. 7 and 8, the point P1 at which the cursor pressing operation is started, the point Pt at which the pressed cursor is released, and the trajectory on which the cursor moves between the points Pt and P1 From the curve R3 obtained using the points Q2, Q3 and Q4 as control points, a curve E3 having a length D extending beyond the point Pt may be determined as an extended trajectory, or the point Pt and the point The point Q5 that exists at a predetermined distance from the point Pt on the trajectory where the cursor moved before the operation of releasing the cursor at Pt, and the points Q6 and Q7 on the trajectory where the cursor moved between those points Pt and Q5 And a curve E4 having a length D extending beyond the point Pt from the curve smoothly passing through Q8 and Q8 may be determined as the extended trajectory. Also, the control point is obtained from the point Pt, the point where the cursor was at a predetermined time before releasing the cursor at the point Pt, and one or more points on the trajectory where the cursor moved between those points. A curve E4 having a length D extending beyond the point Pt from the obtained curve may be determined as the extension trajectory.

  Note that, here, an extended trajectory extending in contact with the point Pt at which the operation of releasing the cursor was performed is described as an example, but the extended trajectory may be any one that extends beyond the point Pt. It may extend with a length D from a position away from Pt to some extent. Note that the position of the starting point of the extended track may be determined based on the size of the decorative part set in the strength setting unit 32.

  The arrangement part 34 (decoration part arrangement means) arranges the decoration parts along the extension trajectory determined by the extension trajectory determination part. For example, as shown in FIG. 9 and FIG. The reference points S1, S2, ..., S7 are set on Ej at equal intervals, and for each set reference point, a regular triangle of random size having the reference point at the center of gravity is set. Place decorative parts at each vertex of the triangle. Thereby, an arrangement image as shown in FIG. 11 is obtained.

  The arrangement processing unit 34 further has a function of arranging decorative parts in a different arrangement manner in the main subject area and other areas detected by the detection unit 37 using the conventional object detection method. For example, when the face area is detected as the main subject in the person image of FIG. 11, the decoration parts arranged overlapping the face area are deleted as shown in FIG. 12, or the decoration parts as shown in FIG. It is possible to rotate and reduce the triangle set for arranging the attached parts so that the decorative parts do not overlap with each other on the face area.

  Further, by treating the detected main subject area as a layer different from the other areas, for example, as shown in FIG. 14, the decoration part is behind the main subject (here, the entire person area) and the other areas. It can also be arranged in front of.

  In the arrangement of the decorative parts, the number of reference points and the types of polygons (triangles, quadrangles, combinations thereof, etc.) are determined based on the number of decorative parts set in the strength setting unit 32, etc. Alternatively, the reference point arrangement interval may be determined according to the size of the photographic image.

  The size of the polygon set corresponding to each reference point may be random, but may be set in advance so as to gradually increase or decrease along the extended trajectory. Good.

  In addition, each polygon may have a corresponding reference point at the rough center of the polygon, or may have a reference point that is off the center. Rotating at an arbitrary angle with respect to a predetermined reference axis.

  In the above description, the case where the decorative component is arranged along the straight extended track is described as an example. However, even when the extended track is a curve, the decorated component can be arranged by the above-described method. For example, as shown in FIGS. 15 and 16, reference points S11, S12, and S16 are set at equal intervals on the extended trajectory Ek of the curve, and each reference point has the reference point at the center of gravity. Randomly sized equilateral triangles are set to a random inclination, and a decorative part is placed at each vertex of the set triangles. Thereby, an arrangement image as shown in FIG. 17 is obtained.

  In addition, the above-described various correspondences in the case where the decorative component is arranged along the linear extension track can also be applied to the case where the decorative component is arranged along the curved extension track.

  With the above configuration, when placing a decorative part, for example, an operation of pressing the cursor on the selection button of the decorative part to be placed displayed on the display screen is started, and the desired part remains pressed. Position the cursor on the selection button until the number, size, and color of the decoration parts are set. When the desired setting is reached, continue pressing and hold in the direction you want to place the decoration parts and the length of the range you want to place. Move the cursor at the appropriate speed, and release the cursor immediately before entering the area where you want to place the decorative part. Thus, a desired number of decorative parts can be arranged in a desired range on the target image by a series of intuitive cursor operations in which the cursor is pressed and released.

  In the above operation example, when the operation of pressing the cursor on the selection button for selection of the decoration part and the like and the operation of releasing the cursor for instructing the placement of the decoration part are performed in a series of operations. However, after an operation of pressing the cursor on the selection button for selecting a decorative part is performed, the decorative part may be arranged by an operation of pressing and releasing the cursor again. .

  According to the above embodiment, when arranging a plurality of decorative parts on the target image displayed on the image display unit 40 based on the operation of the cursor, the operation of releasing the cursor on the image display means is performed. The length D is set based on at least one of the moving distance and moving time of the cursor between the point Pt performed and the point Ph on the trajectory to which the cursor has moved before the operation of releasing the cursor, or the pressing time of the cursor. A length D extending beyond the point Pt of the trajectory from a trajectory defined based on the point Pt and one or more points on the trajectory to which the cursor has moved before the operation to release the cursor. The extension trajectory is determined and a plurality of decoration parts are arranged along the determined extension trajectory, so that a plurality of decoration parts are arranged reflecting the user's intention by a simple cursor operation. be able to.

1 is a schematic configuration diagram of an image processing workstation according to an embodiment of the present invention. The block diagram showing the function which arrange | positions the decoration components of the image processing part of FIG. The figure which shows an example of the display screen displayed on an image display part The figure for demonstrating the process which selects the decoration part, and the process which sets the number of arrangement parts Diagram for explaining the process of determining the extension trajectory of a straight line Diagram for explaining the process of determining the extension trajectory of a straight line Diagram for explaining the process of determining the extended trajectory of a curve Diagram for explaining the process of determining the extended trajectory of a curve The figure for demonstrating the process which arranges a decorative component along a linear extension track | orbit The figure for demonstrating the process which arranges a decorative component along a linear extension track | orbit The figure which shows the example of arrangement which arranged the decoration parts along the straight extension track The figure which shows the example of arrangement | positioning which has arrange | positioned the decoration components so that it may not overlap on a face area | region The figure which shows the example of arrangement | positioning which has arrange | positioned the decoration components so that it may not overlap on a face area | region The figure which shows the example of arrangement | positioning which has arrange | positioned the decoration components so that it may not overlap on a face area | region The figure for demonstrating the process which arranges a decorative component along a linear extension track | orbit The figure for demonstrating the process which arranges a decorative component along a linear extension track | orbit The figure which shows the example of arrangement which arranged the decoration parts along the straight extension track The figure which shows the example of arrangement | positioning which has arrange | positioned the decoration component by the conventional decoration component arrangement | positioning method

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Album editing apparatus 10 Image input part 20 User input part 30 Image processing part 40 Image display part 50 Display control part 31 Decorating part selection part 32 Strength setting part 34 Length determination part 35 Extension track determination part 36 Arrangement part 37 Detection part

Claims (9)

An image processing method for arranging a plurality of decorative parts on a target area displayed on an image display means based on an operation of a cursor,
The movement distance of the cursor between the first point on the image display means where the operation for releasing the cursor is performed and the second point on the trajectory to which the cursor has moved before the operation for releasing the cursor, and Determine the length based on at least one of the travel times or the time the cursor is pressed,
Extends beyond the first point of the trajectory from a trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved prior to releasing the cursor. Determining an extended trajectory of the determined length;
The image processing method, wherein the plurality of decorative parts are arranged along the determined extension trajectory. An image processing device that arranges a plurality of decorative parts in a target area displayed on an image display means based on an operation of a cursor,
The movement distance of the cursor between the first point on the image display means where the operation for releasing the cursor is performed and the second point on the trajectory to which the cursor has moved before the operation for releasing the cursor, and A length determining means for determining the length based on at least one of the movement times or the time of pressing the cursor;
Extends beyond the first point of the trajectory from a trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved prior to releasing the cursor. Extended trajectory determining means for determining an extended trajectory of the length determined by the length determining means;
An image processing apparatus comprising: decoration part arranging means for arranging the plurality of decoration parts along the extension orbit determined by the extension orbit determining means.   The image processing apparatus according to claim 1, further comprising setting means for setting at least one of the number, size, and color of the decoration parts arranged by the decoration part arrangement means.   The setting by the setting unit is displayed on the image display unit, and is based on a duration of an operation to be maintained in a state where the cursor is pressed on a selection button used for selecting the decorative part to be arranged. The image processing apparatus according to claim 2, wherein the image processing apparatus is performed.   The image processing apparatus according to claim 3, wherein an operation of pressing the cursor on the selection button and an operation of releasing the cursor at the first point are performed in a series of operations. The target area is an area where a photographic image exists,
Detection means for detecting a region representing the main subject in the photographic image;
5. The decorative part arranging unit arranges the decorative part in a different arrangement form in the area detected by the detecting unit and in another area. The image processing apparatus according to item.   2. The determination by the length determination unit is performed based on either a moving speed or a moving acceleration of a cursor between the first point and the second point. 6. The image processing apparatus according to any one of items 1 to 5.   The point at which the second point starts the pressing operation of the cursor by the releasing operation and a series of operations prior to the operation of releasing the cursor, and the point where the cursor was at a predetermined time before the operation of releasing the cursor And a point existing at a predetermined distance from the first point on a trajectory along which the cursor has moved before the operation of releasing the cursor. The image processing apparatus according to item. An image processing program for arranging a plurality of decorative parts on the target area displayed on the image display means based on the operation of the cursor,
On the computer,
The movement distance of the cursor between the first point on the image display means where the operation for releasing the cursor is performed and the second point on the trajectory to which the cursor has moved before the operation for releasing the cursor, and Determine the length based on one or both of the travel times,
Extends beyond the first point of the trajectory from a trajectory defined based on the first point and one or more points on the trajectory to which the cursor has moved prior to releasing the cursor. Determining an extended trajectory of the determined length;
An image processing program for causing the plurality of decorative parts to be arranged along the determined extension trajectory.

Images