JP2008147987A - Image synthesizing method, and image synthesizer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image synthesizing method and an image synthesizer by which a specification area with the optional shape is set by simple signal processing. <P>SOLUTION: Pieces of first and fourth positional information corresponding to each of a first, a second, a third and a fourth points are formed at the first, the second, the third and the fourth points where setting of the same point is permitted in the first and second different horizontal directions on a display screen. A pair of pieces of positional information associated with an area connecting the first to the fourth positional information on the display screen from the first to the fourth positional information and in one to a plurality of horizontal directions between the first horizontal direction and the second horizontal direction are formed by an operation. Display pixel information corresponding to between the first and the second positional information, display pixel information corresponding to between a pair of one to a plurality of positional information calculated by the operation and display pixel information corresponding to between the third and the fourth positional information are replaced with optional image information different from other display pixel information. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique effective when applied to an image synthesizing method and an image synthesizing apparatus, for example, a technique effective for use in a surveillance camera apparatus.

Surveillance cameras often include an area that is not desired to be imaged within an imaging area including the monitoring area or an area that should not be imaged from the viewpoint of privacy protection. As a means for solving this problem, there is a method of masking a specific region of the photographing region with an image having no problem in displaying a monochrome image or the like. In Japanese Patent Laid-Open No. 6-181539, an output image is divided into a plurality of grid-like areas, and a protection area is stored with camera pan angle, tilt angle, horizontal and vertical range information, and for each divided area A method for determining whether or not to include a protection area and masking an area including the protection area is described. In Japanese Patent Laid-Open No. 2001-69494, there is a method of storing and masking a rectangular area in which the upper and lower sides covering the protection area are horizontal and the left and right sides are vertical by the camera pan angle, tilt angle, and coordinates of each vertex of the rectangular area. is described.
JP-A-6-181539 JP 2001-69494 A

  In the prior art described in Patent Documents 1 and 2, the shape of the mask image is limited to a rectangle in which the upper and lower sides are horizontal and the left and right sides are vertical. However, the protection area has various shapes, and the protection area If all of the above are masked, a part of the area to be monitored is masked, and if the protection area is masked so as not to partially mask the area to be monitored, a part of the protection area is visible. Will cause problems.

  An object of the present invention is to provide an image composition method and an image composition apparatus capable of setting a designated area having an arbitrary shape by simple signal processing. Another object of the present invention is to enable masking of an arbitrary protection area without damaging the monitoring area in the output image of the monitoring camera. The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

  One embodiment in the present application is as follows. That is, the first to fourth position information corresponding to the first and second points and the third and fourth points, which are permitted to set the same point in different first and second horizontal directions on the display screen, are formed. To do. A pair in one or more horizontal directions between the first horizontal direction and the second horizontal direction corresponding to a region connecting the first to fourth position information on the display screen from the first to fourth position information. The position information is formed by calculation. Display pixel information corresponding between the first and second position information, display pixel information corresponding to one or more pairs of position information obtained by the calculation, and the third and fourth position information The display pixel information corresponding to the period is replaced with arbitrary image information different from the other display pixel information.

  Another embodiment of the present application is as follows. That is, position information corresponding to the first, second, third, and fourth points, respectively, for which setting of the same point is permitted in different first and second horizontal directions on the display screen, is stored in the first to fourth storage means. Remember. A position corresponding to a region connecting the first to fourth points on the display screen by the mask processing unit and corresponding to a pair of points in one or more horizontal directions between the first horizontal direction and the second horizontal direction. Form information. The mask processing unit controls the image selection unit to replace the display pixel information of the position information corresponding to the region connecting the first to fourth points with arbitrary image information different from the other display pixel information.

  Arbitrary quadrilaterals and triangles can be formed by four points that are allowed to set the same point in the horizontal direction, so that a designated area can be arbitrarily formed by combining these by simple signal processing.

  FIG. 1 is an explanatory view showing a mask shape according to the present invention. The protection area for masking a specific portion on the output image P1 from the imaging device (camera) is protected with four coordinates (points) consisting of A1, A2, A5, and A6, as shown by the halftone in FIG. It is set by ΔV1 and ΔH1 indicating the inclination of the left side of the region, and ΔV2 and ΔH2 indicating the inclination of the right side. The coordinates of A1 and A2 are provided in the same horizontal direction (V1), and A5 and A6 are provided in the same horizontal direction (V2) different from A1 and A2. By setting such a condition, the coordinates of A3 and A4 are automatically obtained from A1 and A2, and are used when the inclinations ΔV1 and ΔH1 and ΔV2 and ΔH2 are obtained.

  For example, since the upper and lower sides are horizontal, if the coordinates of A1 are (H1, V1) and the coordinates of A4 are (H2, V2), the coordinates of A2 are (H2, V1), and the coordinates of A3 are (H1 , V2). The protected area calculates ΔV1 and ΔH1 from coordinates A1 and A5, and calculates ΔV2 and ΔH2 from A2 and A6. The horizontal coordinate from V1 to V2 is the horizontal coordinate H1 ′ (H2 ′) obtained by changing the horizontal coordinate H1 (H2) by ΔH1 (ΔH2) for each ΔV1 (ΔV2). It is calculated by calculating. As a result, the mask image (protection area) can be set in a trapezoidal shape with the left and right sides inclined. The present application is characterized by permitting the coordinates of A1 and A2 or A3 and A4 to be the same. By adding such conditions, it is possible to set multiple protection areas such as rectangles, trapezoids, parallelograms, and triangles by specifying the above four points (A1, A2, A5, A6). It becomes.

  The rectangle can be specified by four points where the upper and lower sides are horizontal and the left and right sides are vertical. The trapezoid can be specified by making the distance A1-A2 different from the distance A5-A6 as described above. The parallelogram can be determined by making the distance A1-A2 equal to A5-A6. The triangle can be set by setting A1 and A2 or A5 and A6 to the same coordinate. Since it is possible to set a trapezoidal shape other than a rectangle, a parallelogram, and a triangular protection area in this way, in a surveillance camera device as described later, a protection area having flexibility along the monitoring area can be set, It is possible to improve compatibility between the monitoring function and privacy protection.

  By inclining the left and right sides of the mask image as described above, it is possible to mask a protection area other than a rectangle in which the upper and lower sides are horizontal and the left and right sides are vertical without damaging the monitoring area. The basic shape of the mask image is a quadrangle whose left and right sides are vertical and whose upper and lower sides are horizontal. By tilting the left and right sides, a mask image other than a rectangle is made possible, and one or more mask images are displayed. By using it, the protection area and the monitoring area included in the output image from the camera can be separated as accurately as possible. Any two-dimensional figure can be basically represented by a combination of a plurality of triangles. However, when a triangle is used as a basic shape of a mask image, two mask images are necessarily required to represent a quadrangle. On the other hand, a triangular region can also be set by allowing a trapezoid as a basic shape and making the coordinates of both the upper side and the lower side the same. As a result, the protection area that can be set in the present invention can set a plurality of protection areas of a trapezoid, a parallelogram, and a triangle other than a rectangle as described above.

  Theoretically, ΔV1 and ΔH1 (or θ1) can be set to the coordinates A1 and A3, and the coordinates A5 can be obtained by calculation. When setting an area, the lower end of the protection area is specified by the A1, A2, and A5, A6 which can be directly specified rather than obtained by calculation, and ΔV1, ΔH1 (or θ1) is obtained by calculation, It is more practical to calculate the H1 ′ and H2 ′ on the horizontal line.

  FIG. 2 is a block diagram showing one embodiment of the surveillance camera according to the present invention. The image sensor is composed of a fixed imaging device made of CCD or MOS, and outputs a video signal as an analog signal or a digital signal. The camera signal processing LSI has an AFE (Analog Front End) for analog input signals. The AEF includes a CDS (Correlated Double Sampling) circuit for removing noise, a PGA (Programmable Gain Amplifier) circuit for optimizing a signal level, and an ADC circuit for performing analog / digital conversion.

  The AFE output signal or the digital video signal from the image sensor is subjected to luminance signal processing and color signal processing by a camera signal processing unit. In this embodiment, as described above, a mask processing unit is provided for setting a region that is not desired to be imaged in the imaging region including the monitoring region or a region that should not be imaged from the viewpoint of privacy protection. The imaging signal formed by the camera signal processing unit is partially masked through the mask processing unit, converted into a format suitable for the display device by the format conversion unit, and converted into a digital input display device such as a liquid crystal panel. On the other hand, it is output as it is in the form of a digital signal, and is converted to an analog signal via a digital / analog conversion circuit DAC and output to an analog input display device such as a CRT. The microcomputer controls the image sensor, AFE, camera signal processing unit, mask processing unit, format conversion unit, and DAC. The coordinate setting unit is used to perform control input such as a cursor operation for inputting the coordinates of the mask position.

  FIG. 3 shows a block diagram of an embodiment of the mask processing unit of FIG. The V counter 2 is reset by the vertical synchronization signal VSYNC formed by the camera signal processing unit, and counts the number of lines from the head of the output image P1 of FIG. 1 by counting the horizontal synchronization signal HSYNC. The H counter 3 is reset by the horizontal synchronization signal HSYNC and counts the number of pixels from the head of each line. Thereby, coordinate information on the output image P1 can be obtained. The mask image generation unit 1 forms a mask signal MD to be replaced with the camera signal processing output VS formed by the camera signal processing unit.

  The mask area setting units 41 to 4N are configured by N sets of circuits. The N sets of mask area design units include registers 51 to 58 for storing each set value, a vertical direction area determination unit 61, and a horizontal direction area determination unit, as the mask setting unit 41 is exemplarily shown as a representative example. 62, an H1 ′ arithmetic unit 63, a ΔV1 counter 64, an H2 ′ arithmetic unit 65, and a ΔV2 counter 66. The vertical direction region determination unit 61 and the horizontal direction region determination unit 62 form determination signals VMSK and HMSK, respectively, for determining whether the camera image processing output YD is within the mask region. The image selection unit 7 selects the camera signal processing output VS or the mask signal MD in response to the determination signals VMSK and HMSK, and forms an output signal VDSP to be supplied to the display device.

  The ΔV1 counter repeats counting for ΔV1 from the head line of the mask image based on the output of the vertical direction area determination unit 61. Similarly, the ΔV2 counter repeats counting for ΔV2 from the head line of the mask image based on the output of the vertical direction area determination unit 61. The H1 ′ calculation unit 63 adds / subtracts the ΔH1 set value to / from the H1 setting for each ΔV1 from the head line of the mask image based on the storage information of the H1 setting register 51 and the ΔH1 setting register 54 and the output of the ΔV1 counter. The coordinates H1 ′ of H1 are calculated. Similarly, the H2 ′ calculator 65 adds / subtracts the ΔH2 set value to / from the H2 setting for each ΔV2 from the head line of the mask image based on the information stored in the H2 setting register 56 and the ΔH2 setting register 57 and the output of the ΔV2 counter. Calculate new H2 coordinates H2 '. The horizontal area determination unit 62 determines the horizontal area of the mask image for each line from the count values of the H1 'calculation unit 63, H2' calculation unit 65, and H counter 3.

  In the mask area setting unit 4 of this embodiment, V1, V2, H1, H2 and ΔV1, ΔV2, and ΔH1, ΔH2 set values are stored in the respective registers 51-58. In FIG. 1, the four points A1, A2, and A3, A4 are designated by V1, V2, H1, and H2, and the points A5 and A6 are designated as ΔV1, ΔH1, ΔV2, and ΔH2. It does not mean that it is specified indirectly with. Of course, such designation is not hindered, but it is much easier to directly input A5 and A6 when setting the area. In this embodiment, by inputting the A1, A2, A5, and A6 by the coordinate setting unit of FIG. 2, the microcomputer generates ΔV1, ΔH1, ΔV2, and ΔH2, and each register of the mask area setting unit 41 To enter.

  FIG. 4 is a flowchart for explaining the operation of the mask area setting unit shown in FIG. In step (1), the vertical synchronization signal VSYNC is detected. Accordingly, it is possible to detect the output timing of the pixel signal (the last pixel of one screen) corresponding to the lower right end on the output image P1 of FIG. In step (2), the V counter 2, the ΔV1 counter 64, and the ΔV2 counter 66 are reset.

  In step (3), it is determined whether the counter value of the V counter 2 is between V1 and V2 (V1 ≦ V counter value ≦ V2). If it is between the above V1 and V2, step (4) determines whether the counter value of the ΔV1 counter 64 is ΔV1 or the counter value of the ΔV2 counter 66 is ΔV2. When the counter value of the ΔV1 counter 64 is ΔV1 or the counter value of the ΔV2 counter 66 is ΔV2, calculations of H1 ′ = H1 ± ΔH1 and H2 ′ = H2 ± ΔH2 are performed in step (5). H1 'is replaced with H1 before the calculation by a register provided in the H1' calculation unit. In the subsequent calculation, H1 (H1 ') updated by the calculation is used instead of H1 set in the H1 setting register. The same applies to H2 '. That is, since ΔV at which the coordinates of H1 for one pixel change is obtained, the coordinates of H1 move as +1 or −1 for one pixel for each ΔV as described above.

  In step (6), the area of the mask image is determined. That is, in the line Vx (in the case of V1 ≦ Vx ≦ V2, the pixel signal of H1 ≦ Hx ≦ H2 is replaced with the mask data MD, and otherwise, the imaging signal VS is selected. In step (7), The enable of the ΔV counters 64 and 66 is turned on, and in step (8), the horizontal sync signal HSYNC is detected, and if the horizontal sync signal HSYNC is detected, in step (9), the V counter is incremented by +1. In step (10), it is determined whether the ΔV counter is enabled, and if the enable is turned on (step 11), the ΔV counter is updated by +1, and the step (3) is performed. Return to.

  When the pixel signal of the imaging signal VS is other than the horizontal lines V1 and V2, it is determined in step (12) that V counter <V1 setting. When V counter <V1 is set, the process proceeds to step (8), and only the update operation of the V counter is performed. When V counter> V 1 is set, that is, the condition that V counter> V 1 is set instead of V 1 ≦ V counter value ≦ V 2 is a horizontal line equal to or lower than V 2. Turn off enable and exit.

  FIG. 5 is an operation explanatory diagram showing the movement of the V counter and the ΔV1 counter (ΔV2 counter) of FIG. 2 in a graph. The vertical axis represents the count values of the V counter and ΔV1 counter (ΔV2 counter), and the horizontal axis represents the elapsed time. The V counter is reset when the vertical synchronizing signal is detected, and thereafter, the number of lines is counted until the next vertical synchronizing signal is detected. The ΔV1 counter (ΔV2 counter) counts the number of lines only when the V count value is not less than V1 and not more than V2. It is reset every time the count value reaches ΔV1 (ΔV2). The coordinate H1 (H2) of the mask image in the horizontal direction changes by ΔH1 (ΔH2) every time the ΔV1 (ΔV2) counter value reaches ΔV1 (ΔV2). Specifically, ΔΔV1 (ΔV2) necessary for increasing or decreasing one pixel is obtained. When the slope (ΔV1 / ΔH1) is not an integer, ΔV1 (ΔV2) necessary for correcting and changing one pixel may be obtained as appropriate.

  In this way, in order to control the mask image for masking the protection area on the output image P1 from the monitoring camera shown in FIG. 1, first, the area determination in the vertical direction is performed from the V counter and the V1 setting and the V2 setting. During the mask image area, the number of lines is counted by the ΔV1 counter (ΔV2 counter). Every time the count value becomes equal to the ΔV1 setting (ΔV2 setting), the coordinate H1 (H2) of the horizontal mask image is changed to ΔH1 (ΔH2). ) New coordinates H1 ′ (H2 ′) changed by the amount are calculated, and the horizontal region determination is performed.

  By setting ΔV1 (ΔV2) and ΔH1 (ΔH2) as described above, the coordinates H1 and H2 of the mask image area in the horizontal direction are changed for each line by hardware without software intervention, and a trapezoid other than a rectangle or a parallelogram And mask images including triangles are possible.

  FIG. 6 is a block diagram showing another embodiment of the mask processing unit shown in FIG. In this embodiment, the ΔV1 counter and the ΔV2 counter in the embodiment of FIG. 3 are omitted, and the operation is performed by the H1 ′ operation unit 63 and the H2 ′ operation unit 65. That is, the H1 ′ calculation unit 63 determines the value of the V counter 2 based on the storage information of the H1 setting register 53, the ΔH1 setting register 54, and the ΔV1 setting register, and the output of the output signal of the vertical direction area determination unit 61 and the V counter 2. Each time becomes N times ΔV1, ΔH1 set value is added to or subtracted from H1 setting to calculate a new coordinate H1 ′ of H1. Similarly, the H1 ′ calculating unit 63 determines that the value of the V counter 2 is N times ΔV2 from the outputs of the H2 setting register 56, the ΔH2 setting register 57, the ΔV2 setting register 58, the vertical direction area determination unit 61, and the ΔV2 counter 2. Every time, a new H2 coordinate H2 ′ is calculated by adding / subtracting the ΔH2 set value to / from the H2 setting. The horizontal direction region determination unit 62 determines the horizontal region of the mask image for each line from the count values of the H1 ′ calculation unit 63, the H2 ′ calculation unit 65, and the H counter 3.

  Using the vertical region determination signal VMSK and the horizontal region determination signal HMSK for the mask image as control signals, the output image VS from the image sensor subjected to signal processing and the mask image data MD are switched, and the image subjected to mask processing is selected. A display signal VDSP to be displayed is formed by selection in the unit 7. Such vertical direction region determination unit 61, horizontal direction region determination unit 62, H1 'operation unit 63, H2' operation unit 65, and setting registers 51 to 58 are provided for the required number of masks.

  FIG. 7 is a flowchart for explaining the operation of the mask area setting unit shown in FIG. In FIG. 6, corresponding to the omission of the ΔV1 and ΔV2 counters, the steps (4), (7), (10), and (11) corresponding to the ΔV1 and ΔV2 counters shown in FIG. In (2), resetting of the ΔV1 and ΔV2 counters is omitted. That is, in step (4) and step (5) in FIG. 7, every time the V count value becomes N times ΔV1 setting (ΔV2 setting) during the mask image area, the coordinate H1 ( A new coordinate H1 ′ (H2 ′) obtained by changing H2) by ΔH1 (ΔH2) is calculated, and a horizontal region determination is performed. Specifically, ΔV1 and ΔV2 required to increase or decrease by one pixel are obtained as the N value in the same manner as described above.

  FIG. 8 is an operation explanatory diagram showing the operations of the H1 ′ arithmetic unit and the H2 ′ arithmetic unit in a graph. The vertical axis represents the count value of the V counter 2 and the calculation result in the H1 ′ calculation unit (H2 ′ calculation unit), and the horizontal axis represents the elapsed time. The V counter 2 is reset when the vertical synchronization signal VHSYNC is detected, and thereafter counts the number of lines until the next vertical synchronization signal is detected. The H1 ′ operation unit (H2 ′ operation unit) calculates V counter value ÷ ΔV1 (ΔV2). The coordinate H1 (H2) of the mask image in the horizontal direction is calculated every time the remainder of V counter value ÷ ΔV1 (ΔV2) becomes 0 during the period of V1 setting ≦ V counter value ≦ V2 (that is, V count value = ΔV1 (ΔV2). ) × N (N on the left is an integer)) ΔH1 (ΔH2). In practice, ΔH1 (ΔH2) is set to one pixel, and V count value = ΔV1 (ΔV2) (N) for increasing or decreasing by one pixel is obtained. However, the present invention is not limited to this, and V count value = ΔV1 (ΔV2) necessary for increasing / decreasing a plurality of pixels such as two pixels or three pixels may be obtained.

  FIG. 9 shows an example of a mask area that can be set in the present invention. (A) thru | or (d) show the typical shape which can be set with one mask, and (e) thru | or (h) have shown the typical shape which can be set with the combination of a some mask. (A) is a rectangle and is the simplest shape. In this case, ΔV and ΔH are not necessary. (B) is a trapezoid and is the shape turned upside down from the thing of the said FIG. (C) is a parallelogram. And (d) is a triangle with coordinates A1 = A2.

  (E) is an example of a quadrangle using two masks, a trapezoid as in (b) and a triangle as in (d). (F) is an example of a quadrangle using two triangular masks of (d) above. (G) is an example of a heptagon obtained by combining three masks of a triangle as shown in (d) on the upper side of the rectangle as shown in (a) and a trapezoid as shown in (b) on the lower side. (H) is an example of a pentagon using a trapezoid as shown in (b) and a parallelogram as shown in (c), and further using four masks composed of triangles as shown in (d) above and below. . Incidentally, if the region as shown in (d) is to be formed with only triangles, as many as six masks are required.

  FIG. 10 shows a display example in an in-vehicle camera system to which the present invention is applied. In a right-hand drive automobile, a camera is mounted on the left side, and masks MSK1 and MSK2 are combined on the imaging screen. The mask MSK1 indicates the position of the front end of the automated person, and the mask MSK2 is the left end of the automobile including the door mirror. (Left width). The mask MSK1 can be expressed by a single mask by an elongated rectangle. The mask MSK2 can be expressed by an elongated parallelogram. In this way, by using the two mask functions to display the front end and the left end of the automated person on the display screen, when left-justified on a narrow road, for example, in the example of FIG. Can be prevented. Although not shown, when there is an obstacle ahead in a parking lot or the like, the tip mask MSK1 can prevent contact with the obstacle.

  FIG. 11 shows a block diagram of an embodiment of the mask image generation unit shown in FIGS. 3 and 6. In the mask image generation unit, the luminance settings 1, 2,... N are stored in the registers 13 to 15 and the color settings 1, 2,. The video output Yout from the camera signal processing unit is signal-converted through the amplitude conversion unit 11 and the mosaic processing unit 12 to output a signal. In the amplitude converter 11, the amplitude of the luminance signal Yout is set to 1/2, 1/4... 1 / M. When the interval is set to 10 pixels, the mosaic processing unit 12 performs mosaic processing for outputting a video signal of a specific pixel in the area of 10 pixels × 10 pixels. Alternatively, the circuit configuration is reduced and mosaic processing is performed only in the horizontal direction. In the image selection unit 7, the luminance signal Yout and color signal Cout from the camera signal processing unit and the outputs MD1 to MD9 of the mask image generation unit 1 are input to the selectors 71 and 72 of the image selection unit 7, and there are as many verticals as there are masks. The direction area determination signal VMSK and the horizontal area determination signal HMSK are input to the selection control unit 73 to switch the video signal between the monitoring area and the mask area.

  With the above configuration, the following effects can be given to each mask region. By selecting the settings MD3 to MD9 from the microcomputer, the luminance signal that has passed through the selector 71 and the color signal that has passed through the selector 72 can be filled with a single color. The luminance signal selects the output Yout of the camera signal processing unit, and the color signal selects a setting (MD7 to MD9) from the microcomputer, thereby realizing a semi-transparent display effect. The luminance signal is the output MD1 of the amplitude converter 11, and the color signal is selected from the microcomputer. Various display effects can be realized by changing the combination. By displaying the translucent glass or mosaic processed image in the mask area, it is possible to improve the monitoring function while protecting the privacy.

  FIGS. 12 to 14 are explanatory diagrams of the mask area setting procedure in the monitoring apparatus according to the present invention. FIG. 12 shows a protection area to be set. When obtaining setting information corresponding to such a protection area, the cursor is moved by operating the coordinate setting unit in FIG. 2 to display marks 1 to 4 as shown in FIG. 13 at the apex of the protection area. Let It is not necessary to display these four marks 1 to 4 at the same time, and one cursor is sequentially moved as marks 1 to 4, and the cursor coordinates (V1, H1), (V2, H2) at each point. , (V3, H3), (V4, H4) are taken out. When the coordinates of four points are extracted for each mask, the cursor is moved only as V1 = V2 and V3 = V4.

  In order to actually mask the area surrounded by the marks 1 to 4, in addition to the coordinates of each mark, as shown in FIG. 14, the coordinates of the intersection a where the line descended from the mark 2 and the bottom intersect, ΔV1, ΔV2, ΔH1, and ΔH2 are required, and these are obtained by calculation. Since the coordinate Va of the intersection a coordinate is equal to V4 of the mark 4 and Ha is equal to H2 of the mark 2, the coordinate (Va, Ha) = (V4, H2) of the intersection a. ΔV1 and ΔH1 for setting the slope of the left side can be obtained by dividing (difference between V3 and V1) and (difference between H3 and H1) by a common divisor. When there are multiple common divisors, the slope of the left side becomes smoother as it is divided by a smaller common divisor, and the slope of the left side becomes a staircase as it is divided by a larger common divisor. ΔV2 and ΔH2 for setting the slope of the left side are the same as those on the left side, and are obtained by dividing (difference between V4 and V2) and (difference between H4 and H2) by the common divisor. Further, as described above, ΔV for increasing or decreasing one pixel (ΔH) in the horizontal direction on each of the left side and the right side may be obtained.

  In this way, if a mark is set at the apex of the protection area and the coordinate data is taken in, the mask can be visually set, and other necessary information can be obtained by calculation. The common divisor when performing this calculation may be determined in advance to use the maximum value or the minimum value, or may be set each time. When the protection area is rectangular, the coordinates of the marks 1 to 4 can be used as they are when setting the mask. Alternatively, rectangles, triangles, and trapezoids corresponding to the plurality of masks shown in (e) to (h) by directly inputting the respective points in the regions as shown in (e) to (h) of FIG. Alternatively, it may be decomposed into parallelograms, and the same processing as described above may be performed by calculation for each mask.

  As mentioned above, the invention made by the present inventor has been specifically described based on the embodiments. However, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. Not too long. For example, the setting information for setting the mask area uses the cursor by the coordinate setting unit as described above, or directly inputs and displays the numerical value of the point by a microcomputer or the like, and corrects the final value. A mask area may be set. The image composition method and the image composition apparatus can be widely used as a method and apparatus for setting a region when displaying a plurality of image signals on a single display screen, in addition to a surveillance camera system and an onboard camera system. it can.

It is explanatory drawing of the mask shape which concerns on this invention. It is a block diagram which shows one Example of the surveillance camera which concerns on this invention. It is a block diagram which shows one Example of the mask process part of FIG. FIG. 4 is a flowchart for explaining the operation of a mask area setting unit in FIG. 3. FIG. 3 is an operation explanatory diagram showing movements of the V counter and the ΔV1 counter (ΔV2 counter) of FIG. 2 in a graph. It is a block diagram which shows another Example of the mask process part of FIG. FIG. 7 is a flowchart for explaining the operation of the mask area setting unit in FIG. 6. FIG. 7 is an operation explanatory diagram showing operations of the H1 ′ arithmetic unit and the H2 ′ arithmetic unit in FIG. 6 in a graph. It is explanatory drawing of the mask area | region which can be set by this invention. It is explanatory drawing of the example of a display in the vehicle-mounted camera system to which this invention was applied. It is a block diagram which shows one Example of the mask image generation part shown in FIG. 3, FIG. It is 1st explanatory drawing of the mask area | region setting procedure in the monitoring apparatus which concerns on this invention. It is 2nd explanatory drawing of the mask area | region setting procedure in the monitoring apparatus which concerns on this invention. It is 3rd explanatory drawing of the mask area | region setting procedure in the monitoring apparatus which concerns on this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mask image generation part, 2 ... V counter, 3 ... H counter, 41-4N ... Mask setting part, 51-58 ... Setting register, 61 ... Vertical direction area | region determination part, 62 ... Horizontal direction area | region determination part, 63 ... H1 ′ arithmetic unit, 64... ΔV1 counter, 65... H2 ′ arithmetic unit, 66... ΔV2 counter, 7... Image selection unit, 11 ... amplitude conversion unit, 12 ... mosaic processing unit, 13 to 18. ... selector, 73 ... selection control unit.

Claims (12)

First and second position information corresponding to first and second points, respectively, for which setting of the same point is permitted in the first horizontal direction on the display screen;
Forming third and fourth position information corresponding to the third and fourth points, respectively, for which setting of the same point is permitted in a second horizontal direction different from the first horizontal direction on the display screen;
A pair of one or more horizontal directions between the first horizontal direction and the second horizontal direction corresponding to a region connecting the first to fourth points on the display screen from the first to fourth position information. The position information corresponding to the point is formed by calculation,
Display pixel information corresponding between the first and second position information, display pixel information corresponding to one or more pairs of position information obtained by the calculation, and the third and fourth position information An image composition method for replacing display pixel information corresponding to the period with arbitrary image information different from other display pixel information. In claim 1,
The first position information and the third position information are located on the left side on the display screen,
The second position information and the fourth position information are located on the right side on the display screen,
From the number of pixels in the vertical direction between the first position information and the third position information and the number of pixels in the horizontal direction between the first position information and the third position information, the first horizontal direction and the second horizontal Left side position information of a pair of position information in one or more horizontal directions between directions is obtained by calculation,
From the number of pixels in the vertical direction between the second position information and the fourth position information and the number of pixels in the horizontal direction between the third position information and the fourth position information, the first horizontal direction and the second horizontal An image composition method in which right position information of a pair of points in one or more horizontal directions between directions is obtained by calculation. In claim 2,
A plurality of sets of storage means including the first to fourth position information as one set;
An image composition method for replacing display image information corresponding to the plurality of sets of position information with arbitrary image information different from other display image information. In claim 3,
The image display method, wherein the other display image information is a video signal formed by a monitoring camera corresponding to the display screen. In claim 3,
Display a freely movable cursor on the display screen,
An image composition method for obtaining the first to fourth position information for each set from the display position of the cursor. First and second storage means for storing position information corresponding to the first and second points, respectively, for which setting of the same point is permitted in the first horizontal direction on the display screen, and the first horizontal on the display screen Including third and fourth storage means for storing position information corresponding to each of the third and fourth points for which setting of the same point is permitted in a second horizontal direction different from the direction, A mask processing unit corresponding to a region connecting the first to fourth points and forming position information corresponding to a pair of points in one or more horizontal directions between the first horizontal direction and the second horizontal direction;
An image selection unit that replaces the display pixel information corresponding to the position information corresponding to the region connecting the first to fourth points with arbitrary image information different from other display pixel information by the mask processing unit; Image composition device. In claim 6,
The first point and the third point are located on the left side on the display screen,
The second point and the fourth point are located on the right side on the display screen,
The mask processing unit determines the first horizontal direction and the first horizontal direction based on the number of pixels in the vertical direction between the first point and the third point and the number of pixels in the horizontal direction between the first point and the third point. Calculating the left point of a pair of points in one or more horizontal directions between two horizontal directions,
From the number of pixels in the vertical direction between the second point and the fourth point and the number of pixels in the horizontal direction between the third point and the fourth point, between the first horizontal direction and the second horizontal direction. An image that forms the position information corresponding to the pair of points in one or more horizontal directions between the first horizontal direction and the second horizontal direction by calculating the right point of the pair of points in one or more horizontal directions. Synthesizer. In claim 7,
A plurality of sets of storage means with the first to fourth points as one set;
An image synthesizing apparatus that replaces the display image information for the plurality of sets with arbitrary image information different from other display image information. In claim 8,
The other display image information is an image composition device that is a video signal formed by a monitoring camera corresponding to the display screen. In claim 9,
A coordinate setting unit for displaying an arbitrarily movable cursor on the display screen;
An image synthesizing apparatus that obtains positional information of the first to fourth points for each set from the display position of the cursor. In claim 10,
Having a mosaic processing unit for receiving the video signal and forming a mosaic image;
The arbitrary image information is an image composition device that is an image signal formed by the mosaic processing unit. In claim 10,
It has a brightness setting part and a color setting part,
The arbitrary image information is an image composition device that is an image signal formed by the luminance setting unit or the color setting unit.

Images