JP2012199738A - Image forming apparatus, image forming system, and image forming program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To copy a document on which a code pattern is printed, so that an electronic pen is capable of reliably detecting the position of the code pattern.SOLUTION: An image forming apparatus is provided with: an image input part which scans an original document obtained by superimposing the code pattern detectable by the electronic pen on a document image; an image processing part which identifies the code pattern by analyzing a scanned image obtained by scanning the original document and erases the code patter from the scanned image; an image creation part which newly creates a code pattern; an image composition part which superimposes the code pattern created by the image creation part on the image which is obtained by erasing the code pattern from the scanned image by the image processing part; and an image output part which prints the image superimposed by the image composition part to paper to output a copied document.

Description

  The present invention relates to an image forming apparatus, an image forming system, and an image forming program, and more particularly to an image forming apparatus, an image forming system, and an image forming program for copying a document with a combined code pattern.

  In meetings and the like, participants often write handwritten notes and comments on materials distributed as paper media, and when creating minutes, the person in charge is working to collect those handwritten notes and comments. However, collecting handwritten memos and comments is cumbersome and time-consuming, and electronic pens that output handwriting as data have come to be used.

  This electronic pen has a small camera mounted on the pen tip, and the position of the pen tip is identified by handwriting by reading a code pattern (for example, Anoto (registered trademark) pattern) printed on paper with a small camera. This is to output handwriting such as characters, figures and pictures as electronic data, and various proposals have been made regarding how to use the electronic pen.

  For example, in Patent Document 1 below, a client PC detects writing information written with an electronic pen on a sheet of paper in which coordinate information and identification information generated by an image forming apparatus are recorded in a position detection code and printed. A system that makes it easy to search for a desired electronic document by registering writing information identification information for identifying detected writing information and paper identification information is disclosed.

JP 2009-238095 A

  Here, when a document on which a code pattern is printed is distributed to a plurality of participants, the document is copied using an image forming apparatus. For example, the code pattern is partially lost due to poor reading, When the pattern of the code pattern changes (ie, deteriorates) during copying, such as when a black pattern printed with K ink is recognized as RGB and converted to black mixed with YMC ink Therefore, there is a possibility that the code pattern printed on the copied document cannot be read with the electronic pen.

  Even if the code pattern can be copied fortunately without change, the code pattern has a predetermined dot size and interval, so when the original is enlarged / reduced and copied. Has a problem that the code pattern is enlarged / reduced and cannot be detected by the electronic pen. Similarly, when copying with the orientation or paper size changed, there may be a region where the code pattern is not printed, so that there is a problem that the position of the region cannot be detected with the electronic pen.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and a main object of the present invention is to provide an image forming apparatus capable of copying a document on which a code pattern is printed so that the electronic pen can reliably detect the position. And an image forming system and an image forming program.

  In order to achieve the above object, an image forming apparatus according to the present invention is obtained by scanning an original document in which an original document in which a code pattern that can be detected by an electronic pen is combined with a document image, and the original document is scanned. An image processing unit that analyzes a scan image to identify a code pattern, erases the code pattern from the scan image, an image creation unit that newly creates a code pattern, and the image processing unit generates a code pattern from the scan image. An image combining unit that combines the erased image with the code pattern generated by the image generating unit; and an image output unit that prints the image combined by the image combining unit on paper and outputs a copy document. is there.

  According to another aspect of the present invention, there is provided an image forming system including the image forming apparatus, an electronic pen that detects the code pattern and outputs handwritten image data, and a synthesizing apparatus. A communication unit that acquires data of a handwritten image handwritten on the original document and / or the copied document from a pen, a coordinate conversion unit that converts coordinates of the handwritten image, the document image, and the handwritten image. A data synthesizing unit that creates a synthesized image, and the image forming apparatus creates a table that associates the coordinates of the code pattern synthesized with the original document and the coordinates of the code pattern synthesized with the copied document. , The image processing unit transmits an image from which the code pattern has been deleted or an image in which the magnification and / or orientation of the image is changed and the table, and transmits the table to the synthesizer. The coordinate converter of the synthesizer refers to the table, converts the coordinates of the handwritten image handwritten on the copy original to coordinates on the original document, and the data synthesizer of the synthesizer An image in which the image processing unit has deleted the code pattern, an image in which the magnification and / or orientation of the image is changed, a handwritten image handwritten on the original document, and / or a handwritten image on the copied document, A composite image obtained by combining the handwritten image whose coordinates are converted by the coordinate conversion unit is generated and transmitted to the image forming apparatus, and the image output unit of the image forming apparatus prints the composite image on a sheet and combines It outputs the manuscript.

  The present invention also provides an image forming program that operates on an apparatus that creates a copy original by copying an original original in which a code pattern that can be detected by an electronic pen is combined with an original image. The scan image obtained by scanning the document is analyzed to identify the code pattern, and the image processing unit that erases the code pattern from the scan image, the image creation unit that newly creates the code pattern, and the image processing unit It functions as an image synthesizing unit that synthesizes a code pattern newly created by the image creation unit with an image from which the code pattern has been deleted.

  According to the image forming apparatus, the image forming system, and the image forming program of the present invention, a document on which a code pattern is printed can be copied so that the position of the electronic pen can be reliably detected.

  The reason is that when the image forming apparatus reads the original document in which the code pattern is synthesized with the document image, the code pattern is identified and erased from the scanned image, and then the same code pattern or a different code pattern is synthesized again. Even if the code pattern cannot be read accurately, the original document is enlarged / reduced, or the orientation or paper size is changed, the electronic pen does not control the code on the copy document. This is because the pattern can be reliably detected.

  In addition, a table in which the coordinates of the code pattern printed on the original document and the coordinates of the code pattern printed on the copy original are stored is stored, and the electronic pen is used to refer to the table to copy the original. By converting the handwritten image to a position on the original document, the image handwritten on the original document or the copied document can be reliably combined with the document image.

FIG. 3 is a diagram schematically illustrating a schematic operation of the image forming system according to the first exemplary embodiment of the present invention. 1 is a block diagram illustrating configurations of an image forming apparatus, a synthesizing apparatus, and an electronic pen of an image forming system according to a first embodiment of the present invention. It is a figure which shows an example of an Anoto (trademark) pattern. FIG. 3 is a flowchart illustrating an operation (operation for creating a copy original) of the image forming apparatus according to the first exemplary embodiment of the present invention. It is a flowchart figure which shows the operation | movement (operation | movement which synthesize | combines a handwritten image with a manuscript image) of the synthetic | combination apparatus which concerns on 1st Example of this invention. FIG. 5 is a diagram illustrating an example of a screen (copy condition setting screen) displayed on the panel of the image forming apparatus according to the first exemplary embodiment of the present invention. 6 is a diagram illustrating an example of a screen (original reading instruction screen) displayed on the panel of the image forming apparatus according to the first exemplary embodiment of the present invention. FIG. 6 is a diagram illustrating an example of a screen (composite pattern setting screen) displayed on the panel of the image forming apparatus according to the first exemplary embodiment of the present invention. FIG. It is a figure which shows the coordinate of the original document based on 2nd Example of this invention, and a copy original document. It is a figure which shows the table which matches the coordinate of the original document and the coordinate of a copy document based on 2nd Example of this invention. It is a figure explaining the coordinate transformation which concerns on 1st Example of this invention. It is a figure which shows typically schematic operation | movement of the image forming system which concerns on the 2nd Example of this invention. FIG. 10 is a flowchart showing an operation (operation for creating a copy original) of the image forming apparatus according to the second embodiment of the present invention. It is a flowchart figure which shows the operation | movement (operation | movement which synthesize | combines a handwritten image with a manuscript image) of the synthesizing | combining apparatus based on 2nd Example of this invention. FIG. 6 is a diagram illustrating an example of a screen (composite setting screen) displayed on the panel of the image forming apparatus according to the first exemplary embodiment of the present invention. It is a figure which shows the coordinate of the original document based on 2nd Example of this invention, and a copy original document. It is a figure which shows the table which matches the coordinate of the original document and the coordinate of a copy document based on 2nd Example of this invention. It is a figure explaining the coordinate transformation which concerns on 2nd Example of this invention.

  As shown in the background art, an image handwritten with an electronic pen can be used as electronic data by printing a code pattern on a document. However, when copying a document on which a code pattern is printed, At this time, since the form of the code pattern may change, the code pattern on the copied document may not be detected by the electronic pen.

  Even if the copy can be made without changing the form of the code pattern, the code pattern is enlarged / reduced when the original is enlarged / reduced, so that the code pattern on the copy original cannot be detected by the electronic pen. Further, when copying with the orientation and paper size changed, there may be a region where the code pattern is not printed, and thus the position cannot be detected with the electronic pen in that region.

  Therefore, in an embodiment of the present invention, when copying an original document in which a code pattern is combined with a document image, the code pattern is specified and erased from the scanned image obtained by reading the original document, and then the code pattern is again displayed. Compositing to create a copy manuscript.

  At this time, if the copy magnification is the same, it may be more convenient to combine the same code pattern as the original document, or it may be more convenient to combine a code pattern different from the original document. The user is allowed to select whether to synthesize the same code pattern or different code patterns.

  In addition, when different code patterns are used for the original document and the copied document, the handwritten image cannot be combined with the original document image even if the copy document is handwritten with the electronic pen. A table that associates the coordinates of the pattern with the coordinates of the code pattern of the copied document is stored, and the image handwritten on the copied document is coordinate-converted with reference to the table, and the original image and the handwritten image are synthesized. It can be so.

  In order to describe the above-described embodiment of the present invention in more detail, the image forming apparatus, the image forming system, and the image forming program according to the first embodiment of the present invention will be described with reference to FIGS. To do. FIG. 1 is a diagram illustrating a schematic operation of the image forming system according to the present exemplary embodiment, FIG. 2 is a block diagram illustrating configurations of an image forming apparatus, a synthesizing apparatus, and an electronic pen, and FIG. 3 is an Anoto (registered trademark) pattern. It is a figure which shows an example. 4 and 5 are flowcharts illustrating the operation of the image forming system according to the present exemplary embodiment, and FIGS. 6 to 8 are diagrams illustrating examples of screens displayed on the panel of the image forming apparatus. 9 is a diagram showing the coordinates of the original document and the copied document, FIG. 10 is a diagram showing a table associating the coordinates of the original document and the coordinates of the copied document, and FIG. 11 is a diagram for explaining the coordinate conversion. It is.

  As shown in FIG. 1, an image forming system 10 according to the present embodiment includes an image forming apparatus 20 such as an MFP (Multi Function Peripheral) having a scanning function and a printing function, and an electronic device that outputs pen tip locus data. The pen 30 is composed of a combining device 40 such as a computer device that combines the information acquired from the image forming apparatus 20 and the information acquired from the electronic pen 30. Hereinafter, it will be described in detail with reference to the drawings.

[Image forming apparatus]
The image forming apparatus 20 reads and reads an original document (referred to as an original document 50) in which a document image and a code pattern represented by the Anoto (registered trademark) system (hereinafter simply referred to as a pattern) are combined. After erasing the pattern from the scanned image, the original (referred to as copy original 60) is output again by synthesizing the pattern, and the original image and the electronic pen are output based on the composite image acquired from the synthesizing device 40. A manuscript (referred to as a composite manuscript 70) obtained by combining characters and figures handwritten at 30 (referred to as a handwritten image) is output. As shown in FIG. 2, the image forming apparatus 20 includes a control unit 21, a storage unit 22, a display / operation unit 23, a communication unit 24, an image input unit 25, an image processing unit 26, an image creation unit 27, and an image composition unit. 28, an image output unit 29, and the like.

  The control unit 21 includes a CPU (Central Processing Unit) and the like, and controls the operation of each unit of the image forming apparatus 20 according to a program.

  The storage unit 22 includes a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), and the like, and various programs, pattern data, and an original image of the original document 50 read by the image input unit 25. , Setting information relating to copying (magnification, paper size, orientation, etc.), a table that associates the pattern coordinates of the original document 50 and the coordinates of the pattern of the copied document 60, and the like are stored.

  The display / operation unit 23 is a touch panel or the like, and displays various operation buttons, the state of the apparatus, the operation status of each function, and the like on the display unit according to a display signal from the control unit 21. Further, the XY coordinates of the force point pressed by a finger or a touch pen are detected by a voltage value, and the detected position signal is output to the control unit 21 as an operation signal. Specifically, operations such as setting relating to copying, an instruction for reading a document, and setting of a composite pattern can be performed.

  The communication unit 24 includes a NIC (Network Interface Card), a modem, and the like, and establishes communication with the synthesis apparatus 40.

  The image input unit 25 is a photoelectric conversion composed of a light source that scans a document on a document table, a CCD (Charge Coupled Devices) image sensor that converts light reflected by the document into an electrical signal, and a CIS (Contact Image Sensor). And an A / D converter that A / D converts an electrical signal obtained by photoelectric conversion, and optically reads a document image and a pattern printed on an original document 50 placed on a document table .

  The image processing unit 26 identifies a document image and a pattern from the scanned image read by the image input unit 25 (for example, recognizes dots of a predetermined size arranged at substantially constant intervals as a pattern, and images other than the pattern. Is identified as the original image), and the pattern is erased from the scanned image (overlapping each dot with the same color dot as the surrounding area). At this time, the pattern printed on the original document 50 is identified (identifies from which area of the pattern plane the pattern is cut out) based on the pattern configuration (dot arrangement).

  In this embodiment, the image processing unit 26 is configured to specify a pattern. However, when the original apparatus prints the original document 50, the pattern synthesized on the original document 50 is known, so the pattern is specified again. do not have to. When another image forming apparatus prints the original document 50, information specifying a pattern may be acquired from the image forming apparatus (or a server that manages information related to the original document 50). If identification information for specifying a pattern (for example, information indicating the coordinates of the pattern) is added to the pattern, the pattern may be specified using the identification information.

  The image creation unit 27 creates a pattern to be combined with the copy original 60 using the pattern data stored in the storage unit 22. At that time, according to a user instruction, a pattern having the same coordinates as the original document 50 or a pattern having different coordinates from the original document 50 is created.

  The image input unit 25 may not be able to completely read the pattern printed on the original document 50 (a part of the pattern is lost). In this case, the pattern that can be read is used. Then, the pattern printed on the original document 50 may be specified.

  The image synthesizing unit 28 applies the pattern created by the image creating unit 27 (the pattern having the same coordinates as the erased pattern or the erased pattern) to the image processed by the image processing unit 26 (original image from which the pattern is removed from the scanned image). Pattern with different coordinates).

  The image output unit 29 is an element necessary for image formation using an image forming process such as an electrophotographic method or an electrostatic recording method, that is, a charging device, a photosensitive drum, an exposure device, a transfer roller, a transfer belt, a fixing device. The image is composed of an apparatus and the like, and the image synthesized by the image synthesizing unit 28 is printed on a sheet of paper and a copy document 60 is output. Further, based on the composite image acquired from the combining device 40 (an image obtained by combining the original image of the original document 50 and the handwritten image handwritten on the original document 50 and / or the copy original 60), the composite document 70 is output.

[Electronic pen]
The electronic pen 30 is a device that obtains position information by reading a pattern represented by the Anoto (registered trademark) system. As shown in FIG. 2, the electronic pen 30 includes a control unit 31, a storage unit 32, an operation unit 33, a communication unit 34, a writing unit 35, an image reading unit 36, and the like.

  The control unit 31 includes a CPU and the like, and controls the operation of each unit of the electronic pen 30 according to a program.

  The storage unit 32 includes a ROM, a RAM, and the like, and stores various programs, pattern data, handwritten image data generated by the writing unit 35, and the like.

  The operation unit 33 is a switch or button provided on the electronic pen 30 and enables operations such as power ON / OFF, reading start / end, and data transmission.

  The communication unit 34 includes a NIC, a modem, and the like, and communicates with the communication unit of the synthesis apparatus 40 by short-range wireless communication represented by Bluetooth (registered trademark) or wired communication.

  The writing unit 35 identifies the position of the electronic pen 30 based on the pattern read by the image reading unit 36, and generates handwritten image data indicating the locus (positional change over time) of the electronic pen 30.

  The image reading unit 36 is a small CCD or CMOS (Complementary Metal Oxide Semiconductor) video camera for reading a pattern.

  The electronic pen 30 only needs to have a function of recognizing the pattern printed on the paper and outputting the locus of the pen tip as handwritten image data, and the configuration, shape, communication method, and the like are not particularly limited.

[Synthesizer]
The synthesizing device 40 obtains original image data of the original document 50 from the image forming apparatus 20, obtains handwritten image data handwritten on the original document 50 and / or the copy original 60 from the electronic pen 30, and synthesizes them. The computer apparatus generates a composite image and transmits the composite image to the image forming apparatus 20. As shown in FIG. 2, the synthesis device 40 includes a control unit 41, a storage unit 42, a communication unit 43, a coordinate conversion unit 44, a data synthesis unit 45, and the like.

  The control unit 41 is configured by a CPU or the like, and controls the operation of each unit of the synthesis apparatus 40 according to a program.

  The storage unit 42 includes a ROM, a RAM, an HDD, and the like, and includes various programs, original image data of the original document 50 acquired from the image forming apparatus 20, handwritten image data acquired from the electronic pen 30, and patterns of the original document 50. A table or the like for associating the coordinates of the pattern and the coordinates of the pattern of the copy original 60 is stored.

  The communication unit 43 includes a NIC, a modem, and the like, and establishes communication with the image forming apparatus 20 and the electronic pen 30.

  The coordinate conversion unit 44 refers to the above table and converts the coordinates of the handwritten image on the copy original 60 to the coordinates on the original document 50.

  The data synthesis unit 45 synthesizes the original image of the original document 50 acquired from the image forming apparatus 20 with the handwritten image of the original document 50 and the handwritten image of the copy original 60 (the handwritten image coordinate-converted by the coordinate conversion unit 44). Generate a composite image.

  1 and 2 show an example of the image forming system 10 of the present embodiment. A copy original 60 is created from the original document 50, and the original image of the original document 50 and the original document 50 and / or the copy original 60 are shown. As long as the synthesized document 70 synthesized with the handwritten image can be created, the configuration and control thereof can be changed as appropriate. For example, in FIG. 1 and FIG. 2, the image forming apparatus 20 and the synthesizing apparatus 40 are separate apparatuses. However, the function of the synthesizing apparatus 40 may be provided in the image forming apparatus 20. Can be omitted. 1 and 2, the storage unit 22 of the image forming apparatus 20 is configured to store a table that associates the original image of the original document 50 and the coordinates of the pattern, and the like. These pieces of information are stored in a storage device such as a server. You may remember.

FIG. 3 is an example of an Anoto (registered trademark) pattern printed on the original document 50 or the copy document 60. This Anoto (registered trademark) pattern consists of dots arranged in a grid of 0.3 mm intervals, and each unit is a 6 × 6 block, and each dot is shifted vertically and horizontally from the center point. have. Accordingly, the information amount of one unit is ^{26 × 6 × 2} = ²²⁷² . In other words, Anoto pattern will be present 2 ⁷² kinds in one unit. Further, the dot diameter is 0.05 to 0.1 mm, and the dot shift amount is the dot radius, that is, 0.025 to 0.05 mm. Since 1 inch is 0.0254 m, the minimum resolution is (0.0254 m / inch) / (0.05 × 10 ⁻³ m / dot) = 508 dpi, and the maximum resolution is (0.0254 m / inch) / (0.025 × 10 ⁻³ m / dot) = 1016dpi.

  Next, the operation of the image forming system 10 having the above configuration will be described. First, the operation of the image forming image forming apparatus 20 (the operation of creating the copy original 60) will be described with reference to the flowchart of FIG. In the following description, it is assumed that the original document 50 in which the document image and the pattern are combined is created in advance.

  First, the control unit 21 of the image forming apparatus 20 displays a copy condition setting screen 80 as shown in FIG. 6 on the display / operation unit 23 in order to allow the user to set conditions for copying the original document 50. The copy condition setting screen 80 includes items for setting a copy magnification, paper size, orientation, and the like. The user sets each item (here, the magnification is the same magnification, the paper size and the orientation are the original). When the user presses the confirm button, the control unit 21 stores the set copy condition in the storage unit 22.

  Next, the control unit 21 causes the display / operation unit 23 to display a document reading instruction screen 81 as shown in FIG. When the user sets the original document 50 on the document table and presses the confirm button, the image input unit 25 reads the original document 50 (S101).

  Next, the image processing unit 26 analyzes the scan image read by the image input unit 25, and whether there is a pattern composed of dots of a predetermined size arranged at substantially constant intervals in the scan image. Is determined (S102). If there is no pattern, the image output unit 29 prints the scanned image on a sheet of the size set on the copy condition setting screen 80 (S109), and ends the process.

  On the other hand, if there is a pattern, the image processing unit 26 erases the pattern from the scanned image (S103). At that time, a pattern is specified from the dot configuration extracted from the scanned image (which pattern is cut out on the pattern plane), and an image from which the pattern is erased from the scanned image (that is, an original image) The data is specified and stored in the storage unit 22. Even if dots are missing in some areas of the scanned image, it is possible to specify a pattern using dots in other areas. Here, the pattern is specified by extracting dots from the scanned image. However, as described above, the information acquired from the apparatus that printed the original document 50 or the server that manages the information of the original document 50 is used. The pattern may be specified based on the identification information. When the identification information for specifying the pattern is added to the original document 50, the pattern may be specified from the identification information.

  Next, the control unit 21 displays a composite pattern setting screen 82 as shown in FIG. 8 on the display / operation unit 23, and allows the user to combine the same pattern as the original document 50 or a pattern different from the original document 50. Select whether to synthesize. When the same pattern as the original document 50 is synthesized (No in S104), the image creation unit 27 creates a new pattern having the same coordinates as the pattern specified by the image processing unit 26 (S105). When synthesizing a pattern different from the original 50 (Yes in S104), the image creating unit 27 uses a pattern with a coordinate different from the pattern specified by the image processing unit 26 (a pattern obtained by cutting out a different place on the pattern plane). ) Is created (S106).

  Next, the control unit 21 transmits the image data of the original document 50 and a table that associates the coordinates of the patterns of the original document 50 and the copy document 60 to the synthesizing device 40 (S107). FIG. 9 is a diagram showing the coordinates of the patterns of the original document and the copied document. The pattern printed on the original document 50 has the upper left starting point coordinates (x_org, y_org), and the pattern printed on the copied document 60. The upper left starting point coordinates are (x_st, y_st), and a table for associating these coordinates is as shown in FIG.

  Next, the image synthesizing unit 28 synthesizes the original image extracted by the image processing unit 26 and the pattern created by the image creating unit 27 (S108), and the image output unit 29 sets the synthesized image on the designated sheet. Is printed to create a copy original 60 (S109).

  Next, the operation of the synthesizing device 40 will be described with reference to the flowchart of FIG. In the following description, the table for associating the document image data of the original document 50 and the pattern coordinates of the original document 50 and the copy document 60 is acquired from the image forming apparatus 20 and stored in the storage unit 42 in advance. And

  When the user performs handwriting on the original document 50 and / or the copy document 60 using the electronic pen 30 and instructs transmission of handwritten image data, the control unit 41 of the synthesizing apparatus 40 that has received a communication request from the electronic pen 30. Uses the communication unit 43 to acquire handwritten image data (data in which coordinates specified by a pattern read by the image reading unit 36 are described in association with time) from the electronic pen 30 (S201).

  Next, the control unit 41 extracts one handwritten image, compares the coordinates of the handwritten image with the coordinates of the patterns of the original document 50 and the copy document 60 stored in the storage unit 42, and the handwritten image is a copy document. It is determined whether the image is a handwritten image written in 60 (S202). In the case of a handwritten image entered on the copy original 60, it is determined whether or not the pattern printed on the copy original 60 is different from the pattern printed on the original original 50 with reference to a previously stored table (see FIG. S203).

  When the handwritten image is not written on the copy original 60 (No in S202), or when the pattern printed on the copy original 60 is the same as the pattern printed on the original document 50 (No in S203). The data synthesis unit 45 synthesizes the handwritten image with the original image of the original document 50 in accordance with the coordinates described in the data (S205). On the other hand, if it is a handwritten image written on the copy original 60 (Yes in S202) and the pattern printed on the copy original 60 is different from the pattern printed on the original original 50 (Yes in S203), the coordinates The conversion unit 44 converts the coordinates of the handwritten image entered on the copy original 60 into the coordinates on the original document 50 with reference to a previously stored table (S204), and the data composition unit 45 converts the original of the original document 50. A handwritten image is combined with the image according to the converted coordinates (S205).

  FIG. 11 shows the relationship between the coordinates (x, y) of the handwritten image on the copy document 60 and the coordinates (x ′, y ′) on the original document 50, and the synthesizing device 40 uses the table of FIG. With reference to the following equation, the coordinates of the handwritten image of the copy document 60 are converted into the coordinates of the original document 50.

x '= (x-x_st) + x_org
y '= (y-y_st) + y_org

  Thereafter, the control unit 41 determines whether or not all the handwritten images have been processed (S206). If there is an unprocessed handwritten image, the control unit 41 returns to S202 and repeats the same processing. When all the handwritten images have been processed, the control unit 41 combines the original image 50 and / or the composite image data obtained by combining the handwritten image of the copy original 60 with the original image 50 and the image forming apparatus 20. (S207).

  On the other hand, when the image forming apparatus 20 acquires the composite image data from the composition apparatus 40, the image output unit 29 prints the composite image on a sheet of paper, the original image of the original document 50, the original document 50, and / or a copy. A composite document 70 in which the handwritten image of the document 60 is combined is created.

  Thus, according to the present embodiment, when copying the original document 50 in which the pattern is combined with the document image, the pattern is once erased from the scanned image obtained by reading the original document 50, and then, according to the user's instruction, Since the copy original 60 is created by synthesizing the same coordinate pattern or different coordinate patterns, the pattern of the copy original 60 can be reliably detected using the electronic pen 30.

  Further, by synthesizing a pattern different from the original document 50 on the copy document 60, it is possible to easily identify the handwritten image entered with the electronic pen 30, and to reliably combine the handwritten images entered on a plurality of documents. Can do.

  Next, an image forming apparatus, an image forming system, and an image forming program according to a second embodiment of the present invention will be described with reference to FIGS. FIG. 12 is a diagram showing a schematic operation of the image forming system of this embodiment. FIGS. 13 and 14 are flowcharts showing the operation of the image forming system of this embodiment, and FIG. 15 is a view showing an example of a screen displayed on the panel of the image forming apparatus. 16 is a diagram showing the coordinates of the original document and the copied document, FIG. 17 is a diagram showing a table associating the coordinates of the original document and the coordinates of the copied document, and FIG. 18 is a diagram for explaining the coordinate conversion. It is.

  In the first embodiment described above, the case where the same original document 50 is duplicated has been described. However, the original document may be enlarged / reduced to create a copied document. Since the image is enlarged / reduced, even if the pattern can be accurately read by the image input unit 25 of the image forming apparatus 20, the pattern on the copy original cannot be detected by the electronic pen 30. In addition, when a copy original is created by changing the orientation of the original document, or when a copy original is created by changing the paper size, an area where a pattern is not printed may be generated, and the position of the area is set to the electronic pen 30. Cannot be detected.

  Therefore, in this embodiment, even when the original document is enlarged / reduced or the orientation of the original document or the paper size is changed, the pattern on the copy original can be reliably detected by the electronic pen 30. Specifically, as shown in FIG. 12, the image forming apparatus 20 deletes the pattern from the scanned image obtained by reading the original document 50, then scales or changes the direction of the document image, and then changes the pattern. Perform processing to synthesize. Alternatively, the image forming apparatus 20 erases the pattern after scaling or changing the direction of the scanned image read from the original document 50, and then performs a process of synthesizing the pattern.

  In this case, the basic configuration of the image forming apparatus 20 is the same as that of the first embodiment, but the image processing unit 26 deletes the pattern from the scanned image, and then scales and changes the direction of the document image. Or the process of deleting the pattern after scaling or changing the direction of the scanned image, and the image composition unit 28 converts the image creation unit into the original image that has been scaled or changed direction. Processing for synthesizing the pattern created in 27 is performed.

  Hereinafter, the operation of the image forming system 10 of this embodiment will be described. First, the operation of the image forming apparatus 20 (the operation of creating the copy original 60) will be described with reference to the flowchart of FIG. In the following description, it is assumed that the original document 50 in which the document image and the pattern are combined is created in advance.

  First, the control unit 21 of the image forming apparatus 20 displays a copy condition setting screen 80 as shown in FIG. 6 on the display / operation unit 23 in order to allow the user to set conditions for copying the original document 50. When the user sets each item (in this embodiment, the magnification is changed, the paper size is changed, or the orientation is changed) and the confirmation button is pressed, the control unit 21 sets the item. The copied copying conditions are stored in the storage unit 22.

  Next, the control unit 21 causes the display / operation unit 23 to display a document reading instruction screen 81 as shown in FIG. When the user sets the original document 50 on the document table and presses the confirm button, the image input unit 25 reads the original document 50 (S301).

  Next, the image processing unit 26 analyzes the scan image read by the image input unit 25, and whether there is a pattern composed of dots of a predetermined size arranged at substantially constant intervals in the scan image. Is determined (S302). If there is no pattern, the control unit 21 determines the copy condition set on the copy condition setting screen 80 (S303). If the magnification is not changed or the direction is not changed, the image output unit 29 copies the copy. When the scan image is printed on the sheet of the size set on the condition setting screen 80 (S317), and the magnification is changed or the orientation is changed, the image processing unit 26 enlarges / reduces the scan image, After the rotation (S304), the image output unit 29 prints the scanned image that has been enlarged / reduced or rotated on the sheet of the size set on the copy condition setting screen 80 (S317).

  On the other hand, if there is a pattern, the image processing unit 26 deletes the pattern from the scanned image (S305). At that time, a pattern is specified from the dot configuration extracted from the scanned image (which pattern is cut out on the pattern plane), and an image from which the pattern is erased from the scanned image (that is, an original image) The data is specified and stored in the storage unit 22. Even if dots are missing in some areas of the scanned image, it is possible to specify a pattern using dots in other areas. Here, the pattern is specified by extracting dots from the scanned image. However, as described above, the information acquired from the apparatus that printed the original document 50 or the server that manages the information of the original document 50 is used. The pattern may be specified based on the identification information. When the identification information for specifying the pattern is added to the original document 50, the pattern may be specified from the identification information.

  Next, the control unit 21 determines whether or not the magnification set on the copy condition setting screen 80 is equal (S306). If the same is set, the orientation set on the copy condition setting screen 80 is the original document. 50 is determined to be the same (S307). When the magnification is equal and the orientation is the same as that of the original document 50, the image creation unit 27 creates a pattern (a pattern obtained by cutting out a different place on the pattern plane) different from the pattern specified by the image processing unit 26. (S312). If the magnification is equal and the orientation is the same as that of the original document 50, the same pattern as that of the original document 50 may be synthesized. In this case, the same pattern as the pattern specified by the image processing unit 26 in S311. A coordinate pattern may be created.

  If the magnification is variable in S306 or the orientation is not the same as that of the original document 50 in S307, the image processing unit 26 enlarges / reduces the scan image according to the magnification, or scans the image according to the orientation. (S308). Then, it is determined whether the paper size set on the copy condition setting screen 80 is the same as that of the original document 50 (S309). If the paper size is not the same, the same pattern as that of the original document 50 cannot be used. The image creation unit 27 creates a pattern having coordinates different from the pattern specified by the image processing unit 26 (S312).

  On the other hand, when the paper sizes are the same, the same pattern as that of the original document 50 can be used. Therefore, the control unit 21 causes the display / operation unit 23 to display a composite pattern setting screen 82 as shown in FIG. The user is allowed to select whether or not the same pattern as that of the original document 50 is to be synthesized. When the same pattern as the original document 50 is synthesized (No in S310), the image creating unit 27 creates a pattern having the same coordinates as the pattern specified by the image processing unit 26 (S311). When synthesizing a pattern different from (Yes in S310), the image creating unit 27 creates a pattern having coordinates different from the pattern specified by the image processing unit 26 (S312).

  Here, when the scanned image is enlarged / reduced or the orientation is changed, the original image printed on the original document 50 is different from the original image printed on the copy original 60, which original image Since the handwritten image can also be synthesized, the control unit 21 causes the display / operation unit 23 to display a synthesis setting screen 83 as shown in FIG. 15 so that the user can synthesize the handwritten image with the original image of the original document 50. Or whether to synthesize the handwritten image with the original image of the copy original 60. When a handwritten image is combined with the original image of the copy original 60 (No in S313), the original image data of the copy original 60 and a table that associates the coordinates of the patterns of the original original 50 and the copy original 60 are combined. When the image is transmitted to the apparatus 40 (S314) and the handwritten image is combined with the original image of the original document 50 (Yes in S313), the original image data of the original document 50 and the pattern of the original document 50 and the copy original 60 are changed. A table for associating coordinates is transmitted to the synthesizing device 40 (S315).

  FIG. 16 is a diagram showing the coordinates of the patterns of the original document and the copied document. The pattern printed on the original document 50 has the upper left starting point coordinate (x_org, y_org), and the pattern printed on the copied document 60. The upper left start point coordinates are (x_st, y_st) and the lower right end point coordinates (x_end, y_end). The table that associates these coordinates with the copying conditions such as the scaling factor and rotation angle is as shown in FIG. Become.

  Next, the image synthesizing unit 28 synthesizes the original image extracted by the image processing unit 26 and the pattern created by the image creating unit 27 (S316), and the image output unit 29 sets the synthesized image on the designated sheet. Is printed to create a copy original 60 (S317).

  In the above flow, after deleting the pattern from the scanned image, the original image was enlarged / reduced or the orientation was changed. However, this order was reversed to enlarge / reduce the scanned image or change the orientation. Or the pattern may be erased.

  Next, the operation of the synthesizing device 40 will be described with reference to the flowchart of FIG. In the following description, a table for associating the original image data of the original document 50 or the copy document 60 and the pattern coordinates of the original document 50 and the copy document 60 is acquired from the image forming apparatus 20 and stored in the storage unit 42 in advance. It is assumed that

  When the user performs handwriting on the original document 50 and / or the copy document 60 using the electronic pen 30 and instructs transmission of the data of the handwritten image, the control unit 41 of the composition device 40 uses the communication unit 43. Handwritten image data (data in which coordinates specified by the pattern read by the image reading unit 36 are described in association with time) is acquired from the electronic pen 30 (S401).

  Next, the control unit 41 extracts one handwritten image, compares the coordinates of the handwritten image with the coordinates of the patterns of the original document 50 and the copy document 60 stored in the storage unit 42, and the handwritten image is a copy document. It is determined whether the image is a handwritten image written in 60 (S402). In the case of a handwritten image entered on the copy original 60, it is determined whether or not the pattern printed on the copy original 60 is different from the pattern printed on the original original 50 with reference to a previously stored table (see FIG. S403).

  When the handwritten image is not written on the copy original 60 (No in S402), or when the pattern printed on the copy original 60 is the same as the pattern printed on the original document 50 (No in S403). The data synthesis unit 45 synthesizes the handwritten image with the original image of the original document 50 or the copy original 60 according to the coordinates described in the data (S405). On the other hand, if it is a handwritten image written on the copy original 60 (Yes in S402) and the pattern printed on the copy original 60 is different from the pattern printed on the original original 50 (Yes in S403), the coordinates The conversion unit 44 converts the coordinates of the handwritten image entered on the copy original 60 into coordinates on the original document 50 (S404), and the data composition unit 45 converts the original image into the original image of the original document 50 or the copy original 60. A handwritten image is synthesized according to the coordinates (S405).

  FIG. 18 shows the relationship between the coordinates (x, y) of the handwritten image on the copy document 60 and the coordinates (x ′, y ′) on the original document 50, and the synthesizing device 40 uses the table of FIG. With reference to the following equation, the coordinates of the handwritten image of the copy document 60 are converted into the coordinates of the original document 50.

[Rotation angle = 0]
x '= (x-x_st) / scaling factor + x_org
y '= (y-y_st) / scaling factor + y_org
[Rotation angle = 90]
x '= (y_end-y) / scaling factor + x_org
y '= (x-x_st) / scaling factor + y_org
[Rotation angle = 180]
x '= (x_end-x) / scaling factor + x_org
y '= (y_end-y) / scaling factor + y_org
[Rotation angle = 270]
x '= (y-y_st) / scaling factor + x_org
y '= (x_end-x) / scaling factor + y_org

  Thereafter, the control unit 41 determines whether or not all the handwritten images have been processed (S406). If there is an unprocessed handwritten image, the control unit 41 returns to S402 and repeats the same processing. When all the handwritten images have been processed, the control unit 41 synthesizes composite image data obtained by combining the original image 50 and / or the copy original 60 with the original image 50 or the copy original 60. The image is transmitted to the image forming apparatus 20 (S407).

  On the other hand, when the image forming apparatus 20 acquires composite image data from the combining apparatus 40, the image output unit 29 prints the combined image on a sheet, and the original image of the original document 50 or the copy original 60 and the original document 50. In addition, a composite original 70 in which the handwritten image of the copy original 60 is combined is created.

  As described above, according to the present embodiment, when copying the original document 50 in which the pattern is combined with the document image, the pattern is once deleted from the scanned image obtained by reading the original document 50, and the document image is scaled. In order to create a copy original 60 by synthesizing the same coordinate pattern or different coordinate patterns in accordance with a user instruction after the rotation, the electronic pen 30 can be used to reliably detect the pattern of the copy original 60. it can.

  Further, by synthesizing a pattern different from the original document 50 on the copy document 60, it is possible to easily identify the handwritten image entered with the electronic pen 30, and to reliably combine the handwritten images entered on a plurality of documents. Can do.

  In addition, this invention is not limited to the said Example, The structure and control can be changed suitably, unless it deviates from the meaning of this invention.

  For example, in the second embodiment, the case of changing the magnification, the paper size, and the orientation has been described. However, for example, when changing by changing the vertical and horizontal magnifications, when copying a plurality of originals, etc. However, once the pattern is erased and synthesized again, the position on the copy original 60 can be reliably detected by the electronic pen 30.

  In the above-described embodiment, the case where the synthesis device 40 executes the process of synthesizing the original image and the handwritten image has been described. However, the image forming apparatus 20 acquires the handwritten image data from the electronic pen 30, and A configuration may be adopted in which images are synthesized and a synthesized document 70 is output.

  The present invention is applicable to an image forming apparatus having a scanning function and a printing function, an image forming system including the image forming apparatus, and an image forming program that operates on the image forming apparatus.

DESCRIPTION OF SYMBOLS 10 Image forming system 20 Image forming apparatus 21 Control part 22 Storage part 23 Display / operation part 24 Communication part 25 Image input part 26 Image processing part 27 Image preparation part 28 Image composition part 29 Image output part 30 Electronic pen 31 Control part 32 Storage Unit 33 operation unit 34 communication unit 35 writing unit 36 image reading unit 40 composition device 41 control unit 42 storage unit 43 communication unit 44 coordinate conversion unit 45 data composition unit 50 original document 60 copy document 70 composite document 80 copy condition setting screen 81 document Reading instruction screen 82 Composite pattern setting screen 83 Composite setting screen

Claims (9)

An image input unit that scans an original document in which a code pattern that can be detected by an electronic pen is combined with a document image;
An image processing unit that analyzes a scan image obtained by scanning the original document to identify a code pattern, and erases the code pattern from the scan image;
An image creation unit for creating a new code pattern;
An image synthesizing unit that synthesizes a code pattern newly created by the image creating unit with an image obtained by erasing the code pattern from the scanned image by the image processing unit;
An image output unit that prints an image synthesized by the image synthesis unit on paper and outputs a copy document;
An image forming apparatus. The image creation unit creates the same code pattern as the code pattern specified by the image processing unit or a code pattern different from the code pattern specified by the image processing unit according to a user's selection operation.
The image forming apparatus according to claim 1. The image processing unit changes the magnification and / or orientation of the image from which the code pattern has been erased from the scanned image according to the copying conditions set by the user,
In the case where the copy condition is set not to change the paper size, the image creating unit is the same code pattern as the code pattern specified by the image processing unit or the code specified by the image processing unit according to the user's selection operation. Create a code pattern different from the pattern, and if the copy condition is set to change the paper size, create a code pattern different from the code pattern specified by the image processing unit,
The image synthesis unit synthesizes the code pattern created by the image creation unit with an image whose magnification and / or orientation has been changed after the image processing unit erases the code pattern,
The image output unit prints the image combined by the image combining unit on a sheet having a sheet size set in the copy condition;
The image forming apparatus according to claim 1, wherein the image forming apparatus is an image forming apparatus. The image processing unit erases the code pattern after changing the magnification and / or orientation of the scanned image according to the copying conditions set by the user,
In the case where the copy condition is set not to change the paper size, the image creating unit is the same code pattern as the code pattern specified by the image processing unit or the code specified by the image processing unit according to the user's selection operation. Create a code pattern different from the pattern, and if the copy condition is set to change the paper size, create a code pattern different from the code pattern specified by the image processing unit,
The image synthesizing unit synthesizes the code pattern created by the image creating unit with the image from which the code pattern has been erased after the image processing unit has changed the magnification and / or orientation,
The image output unit prints the image combined by the image combining unit on a sheet having a sheet size set in the copy condition;
The image forming apparatus according to claim 1, wherein the image forming apparatus is an image forming apparatus. An image forming system comprising: the image forming apparatus according to claim 1; an electronic pen that detects the code pattern and outputs handwritten image data; and a synthesizing apparatus.
The synthesizer is
A communication unit that acquires data of a handwritten image handwritten on the original document and / or the copied document from the electronic pen;
A coordinate conversion unit for converting the coordinates of the handwritten image;
A data synthesis unit for creating a synthesized image obtained by synthesizing the original image and the handwritten image;
With
The image forming apparatus creates a table associating the coordinates of the code pattern synthesized with the original document and the coordinates of the code pattern synthesized with the copy document, and the image processing unit erases the code pattern or the image The image data with the magnification and / or orientation changed and the table are transmitted to the synthesizer,
The coordinate conversion unit of the synthesizing apparatus refers to the table, converts the coordinates of the handwritten image handwritten on the copy original to the coordinates on the original original,
The data synthesizing unit of the synthesizing device includes an image from which the image processing unit has deleted the code pattern, an image in which the magnification and / or orientation of the image is changed, a handwritten image handwritten on the original document, and / or A composite image obtained by combining the handwritten image handwritten on the copy original and having the coordinates converted by the coordinate conversion unit and transmitted to the image forming apparatus,
The image output unit of the image forming apparatus prints the composite image on a sheet and outputs a composite document.
An image forming system. An image forming program that operates on an apparatus that creates a copy original by copying an original original in which a code pattern that can be detected by an electronic pen is combined with an original image,
Said device,
An image processing unit that analyzes a scan image obtained by scanning the original document to identify a code pattern, and erases the code pattern from the scan image;
An image creation unit for creating a new code pattern;
The image processing unit functions as an image synthesis unit that synthesizes a code pattern newly created by the image creation unit with an image obtained by erasing the code pattern from the scanned image.
An image forming program. The image creation unit creates the same code pattern as the code pattern specified by the image processing unit or a code pattern different from the code pattern specified by the image processing unit according to a user's selection operation.
The image forming program according to claim 6. The image processing unit changes the magnification and / or orientation of the image from which the code pattern has been erased from the scanned image according to the copying conditions set by the user,
In the case where the copy condition is set not to change the paper size, the image creating unit is the same code pattern as the code pattern specified by the image processing unit or the code specified by the image processing unit according to the user's selection operation. Create a code pattern different from the pattern, and if the copy condition is set to change the paper size, create a code pattern different from the code pattern specified by the image processing unit,
The image synthesis unit synthesizes the code pattern created by the image creation unit with an image whose magnification and / or orientation has been changed after the image processing unit has erased the code pattern.
The image forming program according to claim 6 or 7, The image processing unit erases the code pattern after changing the magnification and / or orientation of the scanned image according to the copying conditions set by the user,
In the case where the copy condition is set not to change the paper size, the image creating unit is the same code pattern as the code pattern specified by the image processing unit or the code specified by the image processing unit according to the user's selection operation. Create a code pattern different from the pattern, and if the copy condition is set to change the paper size, create a code pattern different from the code pattern specified by the image processing unit,
The image synthesis unit synthesizes the code pattern created by the image creation unit with an image from which the code pattern has been erased after the image processing unit has changed the magnification and / or orientation.
The image forming program according to claim 6 or 7,

Images