JP2016061603A - Projection device and projection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection device and a projection method, capable of allowing a user to easily confirm a defect existing on a print.SOLUTION: A projection device includes an image acquisition part 407 which acquires a captured image obtained by imaging the print where the defect exists, a defect information acquisition part 409 which acquires defect information on the defect existing on the print, a projection image generation part 415 which generates a projection image where one or more defect information images based on the defect information are associated with the defect on the print, in projection onto a projection area including the print, on the basis of the captured image and the defect information, and a projection part 417 which projects the projection image onto the projection area.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a projection apparatus and a projection method.

  In printing that requires high quality such as production printing, quality inspection for printed matter is required.

  For example, in Patent Document 1, a quality inspection is performed on a printed material by comparing a reference image generated from an original image of the printed material with an inspection image generated by electronically reading the printed material. As a result of the above, there is known a technique for generating defect information relating to defects existing on a printed matter and displaying a superimposed image in which the generated defect information is superimposed on an inspection image.

  However, in the conventional technology as described above, the user cannot confirm the actual defect existing on the printed material unless he / she compares the displayed superimposed image with the printed material, and is troublesome in confirming the defect present on the printed material. I need it.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a projection device and a projection method that allow a user to easily check a defect existing on a printed matter.

  In order to solve the above-described problems and achieve the object, a projection apparatus according to one aspect of the present invention includes an image acquisition unit that acquires a captured image obtained by imaging a printed matter in which a defect exists, and a defect that exists on the printed matter. One or more defect information images based on the defect information when projected onto a projection area including the printed material based on the captured image and the defect information. A projection image generation unit configured to generate a projection image associated with the above defect; and a projection unit configured to project the projection image onto the projection region.

  ADVANTAGE OF THE INVENTION According to this invention, there exists an effect that a user can confirm a defect which exists on printed matter easily.

FIG. 1 is a schematic diagram illustrating an example of a printed matter inspection system according to the present embodiment. FIG. 2 is a block diagram illustrating an example of a configuration of the printing apparatus and the printed matter inspection apparatus according to the present embodiment. FIG. 3 is a diagram illustrating an example of defect information according to the present embodiment. FIG. 4 is a diagram illustrating an example of detailed information of the present embodiment. FIG. 5 is a flowchart illustrating an example of a flow of processing performed by the printed matter inspection apparatus according to the present embodiment. FIG. 6 is a schematic diagram illustrating an example of the projection apparatus of the present embodiment. FIG. 7 is a block diagram showing an example of the configuration of the projection apparatus of the present embodiment. FIG. 8 is a diagram illustrating an example of a captured image of the present embodiment. FIG. 9 is a diagram illustrating an example of a printed region after projective conversion according to the present embodiment. FIG. 10 is a diagram illustrating an example of a captured image after specifying the defect position according to the present embodiment. FIG. 11 is a diagram illustrating an example of a projected image according to the present embodiment. FIG. 12 is a diagram illustrating another example of detailed information of the present embodiment. FIG. 13 is a diagram illustrating an example of a projection state according to the present embodiment. FIG. 14 is a flowchart illustrating an example of a procedure flow of processing performed by the projection apparatus of the present embodiment. FIG. 15 is a block diagram illustrating an example of a hardware configuration of the printing apparatus and the printed matter inspection apparatus according to the present embodiment.

  Hereinafter, embodiments of a projection apparatus and a projection method according to the present invention will be described in detail with reference to the accompanying drawings. In the present embodiment, first, a printed matter inspection system that generates defect information will be described, and then a projection device will be described.

  FIG. 1 is a schematic diagram illustrating an example of a printed matter inspection system 1 according to the present embodiment. As shown in FIG. 1, the printed matter inspection system 1 includes a printing apparatus 100, a printed matter inspection apparatus 200, and a stacker 300.

  The printing apparatus 100 includes an operation panel 101, photosensitive drums 103Y, 103M, 103C, and 103K, a transfer belt 105, a secondary transfer roller 107, a paper feeding unit 109, a conveyance roller pair 111, and a fixing roller 113. , And an inversion path 115.

  The operation panel 101 is an operation display unit that inputs various operations to the printed material inspection system 1 and displays various screens.

  Each of the photosensitive drums 103Y, 103M, 103C, and 103K forms a toner image by performing an image forming process (charging process, exposure process, developing process, transfer process, and cleaning process), and the formed toner image. Is transferred to the transfer belt 105. In this embodiment, a yellow toner image is formed on the photoreceptor drum 103Y, a magenta toner image is formed on the photoreceptor drum 103M, a cyan toner image is formed on the photoreceptor drum 103C, and the photoreceptor drum 103K is formed. Although a black toner image is formed, the present invention is not limited to this.

  The transfer belt 105 conveys the toner image (full color toner image) transferred from the photosensitive drums 103Y, 103M, 103C, and 103K to the secondary transfer position of the secondary transfer roller 107. In this embodiment, a yellow toner image is first transferred to the transfer belt 105, and then a magenta toner image, a cyan toner image, and a black toner image are sequentially superimposed and transferred. However, the present invention is not limited to this. Is not to be done.

  The paper feeding unit 109 stores a plurality of recording papers, and feeds the recording papers.

  The transport roller pair 111 transports the recording paper fed by the paper feed unit 109 in the direction of arrow s on the transport path a.

  The secondary transfer roller 107 collectively transfers the full-color toner image conveyed by the transfer belt 105 onto the recording paper conveyed by the conveyance roller pair 111 at the secondary transfer position.

  The fixing roller 113 fixes the full color toner image on the recording paper by heating and pressing the recording paper on which the full color toner image is transferred.

  In the case of single-sided printing, the printing apparatus 100 discharges a printed matter, which is a recording sheet on which a full-color toner image is fixed, to the printed matter inspection apparatus 200. On the other hand, in the case of double-sided printing, the printing apparatus 100 sends the recording paper on which the full-color toner image is fixed to the reverse path 115.

  The reverse path 115 reverses the front and back surfaces of the recording paper by switching back the fed recording paper and conveys it in the direction of the arrow t. The recording paper conveyed by the reverse path 115 is re-conveyed by the conveying roller pair 111, the full-color toner image is transferred to the surface opposite to the previous one by the secondary transfer roller 107, fixed by the fixing roller 113, and printed. The paper is discharged to the printed product inspection apparatus 200.

  The printed matter inspection apparatus 200 includes reading units 201A and 201B. The reading unit 201A electronically reads one surface of the printed material discharged from the printing apparatus 100, and the reading unit 201B electronically reads the other surface of the printed material discharged from the printing device 100. The reading units 201A and 201B can be realized by, for example, a line scanner. Then, the printed matter inspection apparatus 200 discharges the printed matter that has been read to the stacker 300.

  The stacker 300 includes a tray 301. The stacker 300 stacks the printed material discharged by the printed material inspection apparatus 200 on the tray 301.

  FIG. 2 is a block diagram illustrating an example of the configuration of the printing apparatus 100 and the printed matter inspection apparatus 200 according to the present embodiment. As illustrated in FIG. 2, the printing apparatus 100 includes a RIP (Raster Image Processor) unit 121, a print control unit 123, and a printing unit 125. The printed matter inspection apparatus 200 includes a reading unit 201, an acquisition unit 203, a master image generation unit 205, a buffer 207, an inspection unit 209, and a storage unit 211. In this embodiment, it is assumed that the printing apparatus 100 and the printed material inspection apparatus 200 are connected by a local interface such as USB (Universal Serial Bus) or PCIe (Peripheral Component Interconnect Express). The connection form between the apparatus 100 and the printed matter inspection apparatus 200 is not limited to this, and may be connected via a network such as a LAN (Local Area Network).

  The RIP unit 121 receives print data from an external device such as a host device (not shown), and generates an original image (a basis for printing) from which the printed material is generated from the received print data. Specifically, the RIP unit 121 performs RIP processing on the print data and generates an RIP image (bitmap image) as an original image.

  In the present embodiment, the print data includes data described in a page description language (PDL) such as PostScript (registered trademark), image data in a TIFF (Tagged Image File Format) format, and the like. However, the present invention is not limited to this. In the present embodiment, the original image is CMYK RIP image data, and each pixel of the RIP image data of C (Cyan), M (Magenta), Y (Yellow), and K (Black) is 2-bit 1200 dpi. It shall be, but is not limited to this.

  The print control unit 123 transmits the print job information specified from the data described in the page description language and the RIP image generated by the RIP unit 121 to the printed matter inspection apparatus 200 and transmits the RIP image to the print unit 125. To do. Further, the print control unit 123 uses the defect information transmitted (feedback) from the printed material inspection apparatus 200 to specify, for example, the discharge destination of the printed material that has not passed the quality inspection for the stacker 300 or the quality inspection. The printed material that does not pass is marked, or the printing unit 125 is instructed to perform replacement printing.

  The RIP unit 121 and the print control unit 123, for example, may be realized by software by causing a processing device such as a CPU (Central Processing Unit) to execute a program, or may be realized by software, IC (Integrated Circuit), or ASIC (Application It may be realized by hardware such as (Specific Integrated Circuit) or may be realized by using software and hardware together.

  The printing unit 125 executes a print processing process such as an image forming process, prints a print image based on the RIP image on a recording sheet, and generates a printed matter. In this embodiment, the printing unit 125 is realized by the photosensitive drums 103Y, 103M, 103C, and 103K, the transfer belt 105, the secondary transfer roller 107, the fixing roller 113, and the like, but is not limited thereto. . As described above, in this embodiment, an image is printed by an electrophotographic method, but the present invention is not limited to this, and an image may be printed by an inkjet method.

  The reading unit 201 reads the printed matter generated by the printing unit 125 and generates a read image. Specifically, the reading unit 201 electronically reads a print image on which a print image based on the RIP image is printed, and generates a read image. In the present embodiment, the reading unit 201 is realized by the reading units 201A and 201B. In the present embodiment, the read image is RGB image data, and each pixel of the R, G, and B image data is 8-bit 200 dpi. However, the present invention is not limited to this.

  The acquisition unit 203 acquires the original image and the print job information of the printed material generated by the printing unit 125. Specifically, the acquisition unit 203 acquires C, M, Y, and K RIP images from the printing apparatus 100 (print control unit 123).

  The master image generation unit 205 generates a master image based on the original image acquired by the acquisition unit 203. Specifically, the master image generation unit 205 performs various image processing such as multi-value conversion processing, smoothing processing, resolution conversion processing, and color conversion processing on the original image acquired by the acquisition unit 203, Generate an image. The master image is RGB image data, and each pixel of R, G, and B image data is assumed to be 8-bit 200 dpi, but is not limited to this.

  The acquisition unit 203 and the master image generation unit 205 may be realized by causing a processing device such as a CPU to execute a program, that is, by software, or by hardware such as an IC or an ASIC. However, software and hardware may be used in combination.

  The buffer 207 stores the master image generated by the master image generation unit 205. When the reading unit 201 generates a read image, the buffer 207 outputs a master image used for inspection to the inspection unit 209. The buffer 207 can be realized by, for example, a DRAM (Dynamic Random Access Memory).

  The inspection unit 209 compares the read image generated by the reading unit 201 with the master image generated by the master image generation unit 205, and inspects the quality of the printed matter generated by the printing apparatus 100. Specifically, the inspection unit 209 compares the read image generated by the reading unit 201 with the master image output from the buffer 207 in units of pixels, and calculates a difference value of pixel values of 8 bits for each RGB color for each pixel. To do.

  The inspection unit 209 inspects the quality of the printed matter generated by the printing apparatus 100 based on the magnitude relationship between the difference value for each pixel and the threshold for quality inspection, and the inspection result and the print acquired by the acquisition unit 203. Using the job information, defect information relating to defects in the printed material is generated, stored in the storage unit 211, and transmitted (feedback) to the printing apparatus 100. The storage unit 211 can be realized by, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

  The inspection unit 209, for example, causes a processing device such as a CPU to execute a program, that is, may be realized by software, may be realized by hardware such as an IC or an ASIC, or software and hardware. May be realized in combination.

  FIG. 3 is a diagram illustrating an example of defect information according to the present embodiment. The defect information is information in which a job, a copy, a page, front and back, the number of defects, a read image, and detailed information are associated with each other. In the example shown in FIG. 3, the values of the read image and the detailed information are omitted.

  The job, the copy, the page, and the front and back indicate whether the read image is an image obtained by reading the print of the front or back of what page of what print job. The number of defects indicates the number of defects detected from the read image. The read image is a read image used for quality inspection by the inspection unit 209, and is a read image generated by the reading unit 201.

  A job, a part, a page, and a front and back are examples of printed material information related to a printed material.

  The detailed information is information relating to details of each defect detected from the read image. FIG. 4 is a diagram illustrating an example of detailed information of the present embodiment. Note that the detailed information shown in FIG. 4 is detailed information on defect information of job “100”, part “first copy”, page “1”, and front and back “front” shown in FIG. It is not limited. In the example shown in FIG. 4, the detailed information is information in which the defect number, the defect level, the defect type, the defect area coordinates, and the color information of the defect area are associated with each other.

  The defect No. is a number for identifying each detected defect. The defect level indicates the level (degree) of the defect indicated by the defect No., and is used as a criterion for quality inspection. The defect type is a type of defect indicated by the defect number. The defect area coordinates are the position coordinates of the area where the defect indicated by the defect number is located, and indicate the upper left and lower right position coordinates of the area. In the present embodiment, the region where the defect is located is a rectangular region, but is not limited to this. The color information of the defect area indicates the average color of the area indicated by the defect area coordinates. In the present embodiment, since the read image is RGB image data, the color information of the defect area indicates the average values of R, G, and B in the area indicated by the defect area coordinates.

  The defect number, defect level, and defect type are examples of content information indicating the content of the defect, and the defect area coordinates are an example of area information indicating the area of the defect present on the read image, and the color of the defect area The information is an example of color information indicating the color of the defect area.

  FIG. 5 is a flowchart illustrating an example of a flow of processing performed in the printed matter inspection apparatus 200 according to the present embodiment.

  First, the acquisition unit 203 acquires the original image of the printed material generated by the printing unit 125 and the information of the print job (step S101).

  Subsequently, the user sets the printed matter generated by the printing unit 125 to the printed matter inspection apparatus 200, and inputs an inspection start instruction from the operation panel 101 to the printed matter inspection apparatus 200 (step S103).

  Subsequently, the master image generation unit 205 generates a master image based on the original image acquired by the acquisition unit 203 (step S105).

  Subsequently, the reading unit 201 reads the set printed material and generates a read image (step S107).

  Subsequently, the inspection unit 209 compares the read image generated by the reading unit 201 with the master image generated by the master image generation unit 205, inspects the quality of the printed matter generated by the printing apparatus 100, and detects defects. Information is generated (step S109).

  Then, until the quality of all pages of the printed material is inspected (No in step S111), the processing in steps S105 to S109 is repeated, and when the quality of all pages of the printed material is inspected (Yes in step S111), the inspection unit 209 generates The defect information is stored in the storage unit 211 and displayed on the operation panel 101 (step S113).

  In the flowchart shown in FIG. 5, the example in which the processing in steps S105 to S109 is performed for each page has been described. However, the processing for all pages may be performed at once in steps S105 to S109. Further, the order of steps S105 and S107 may be switched.

  FIG. 6 is a schematic diagram illustrating an example of the projection apparatus 400 of the present embodiment, and FIG. 7 is a block diagram illustrating an example of the configuration of the projection apparatus 400 of the present embodiment. As illustrated in FIGS. 6 and 7, the projection apparatus 400 includes a reception unit 401, a storage unit 403, an imaging unit 405, an image acquisition unit 407, a defect information acquisition unit 409, a determination unit 411, and a defect position. A specifying unit 413, a projection image generation unit 415, a projection unit 417, and an operation unit 419 are provided.

  In the present embodiment, it is assumed that the projection apparatus 400 is an apparatus independent of the printed matter inspection system 1, but the present invention is not limited to this, and the projection device 400 may be integrated with the printed matter inspection system 1.

  The reception unit 401, the image acquisition unit 407, the defect information acquisition unit 409, the determination unit 411, the defect position specification unit 413, and the projection image generation unit 415 cause a processing device such as a CPU (Central Processing Unit) to execute the program, for example. That is, it may be realized by software, may be realized by hardware such as an IC (Integrated Circuit) or ASIC (Application Specific Integrated Circuit), or may be realized by using software and hardware together. Good.

  The storage unit 403 can be realized by, for example, an HDD or an SSD. The imaging unit 405 can be realized by, for example, a digital camera. However, in the present embodiment, it is assumed that the imaging unit 405 has the number of pixels and the angle of view that can capture the entire print target 451 to be imaged at 200 dpi. The projection unit 417 can be realized by, for example, a projector. The operation unit 419 can be realized by, for example, a key switch, a mouse, and a keyboard. Note that the operation unit 419 may be realized by the operation panel 101.

  The receiving unit 401 receives a plurality of pieces of defect information from the printed matter inspection apparatus 200 and stores them in the storage unit 403. It is assumed that the plurality of pieces of defect information are stored in the order of job, copy, page, and front / back, that is, the order generated in the printed matter inspection apparatus 200.

  The imaging unit 405 images an imaging area including the printed material 451 set on the projection device 400. In the present embodiment, when the user sets the printed material 451 on the projection device 400 and performs an imaging start operation from the operation unit 419, the imaging unit 405 starts regular imaging of the imaging region including the printed material 451, When the user performs an imaging end operation from the operation unit 419, the imaging unit 405 ends the imaging.

  The printed material 451 is a printed material that has been subjected to quality inspection by the printed material inspection apparatus 200 and has generated defect information. In addition, when there are a plurality of printed materials for which defect information is generated by the printed material inspection apparatus 200, the above-described imaging is performed in the order of the printed materials subjected to the quality inspection. Here, when the printed material to be imaged is exchanged (next advance), it is performed after the imaging is completed by performing the imaging termination operation.

  The image acquisition unit 407 acquires the captured image captured by the imaging unit 405. Specifically, the image acquisition unit 407 acquires a captured image every time the imaging unit 405 performs imaging. In the present embodiment, the captured image is RGB image data, and each pixel of the R, G, and B image data is 8-bit 200 dpi. However, the present invention is not limited to this.

  The defect information acquisition unit 409 acquires defect information of the printed matter imaged by the imaging unit 405. Specifically, when an imaging start operation is performed from the operation unit 419, the defect information acquisition unit 409 acquires defect information of a printed matter imaged by the imaging unit 405 from the storage unit 403.

  In the present embodiment, the defect information is stored in the order generated in the printed matter inspection apparatus 200, and the printed matter is imaged in the order of the printed matter subjected to the quality inspection. Therefore, when the n (n ≧ 1) imaging start operation is performed from the operation unit 419, the defect information acquisition unit 413 performs n-th defect information stored in the storage unit 403 (n in the printed matter inspection apparatus 200). The defect information of the printed matter imaged by the imaging unit 405 is acquired from the storage unit 403.

  However, the method for acquiring the defect information of the printed matter imaged by the imaging unit 405 from the storage unit 403 is not limited to this, and for example, the imaging unit 405 is selected from a plurality of defect information stored in the storage unit 403. The defect information of the printed matter imaged by the above may be specified, and the specified defect information may be acquired.

  The determination unit 411 determines whether or not the degree of defect information in the defect information acquired by the defect information acquisition unit 409 exceeds a threshold value. For example, the threshold is the defect level “2”, and the defect information acquisition unit 413 acquires the defect information of the job “100”, the part “first part”, the page “1”, and the front and back “front” shown in FIG. To do. In this case, the defects included in the defect information are defect Nos. “1” to “3” (see FIG. 4). Since the defect level of the defect No. “1” is “3”, the determination unit 411 exceeds the threshold value, and the defect levels of the defect Nos. “2” and “3” are “1”. judge.

  The defect position specifying unit 413 extracts a printed material region, which is a printed material region, from the captured image acquired by the image acquisition unit 407, and the read image included in the defect information acquired by the printed material region and the defect information acquisition unit 409. The position of the defect on the picked-up image is specified using the correspondence relationship and the area information included in the defect information.

  Specifically, every time a captured image is acquired by the image acquisition unit 407, the defect position specifying unit 413 extracts a printed region from the captured image, and whether or not it matches the printed region extracted from the previous captured image. (Whether or not the coordinates of the four corners of both printed regions match).

  If the two printed product areas do not match, the defect position specifying unit 413 includes the correspondence between the printed product region extracted this time and the read image included in the defect information acquired by the defect information acquiring unit 409 and the defect information. Using the region information, the position of the defect on the captured image is specified. On the other hand, if the two printed matter areas match, the defect position specifying unit 413 does not specify the position of the defect described above.

  In addition, when the captured image is captured for the first time or when the printed material is once set after being removed from the projection device 400, that is, the printed material region can be extracted from the captured image, Even when the extracted printed region does not exist, the above-described defect position is specified. However, when the printed region cannot be extracted from the captured image, the above-described defect position is not specified.

  With reference to FIGS. 8 to 10, a method for specifying the position of a defect on a captured image according to the present embodiment will be described. FIG. 8 is a diagram illustrating an example of the captured image 501 of the present embodiment, FIG. 9 is a diagram illustrating an example of the printed region 531 after the projective transformation of the present embodiment, and FIG. 10 is a diagram of the present embodiment. It is a figure which shows an example of the captured image 501 after defect position specification.

  First, the defect position specifying unit 413 performs edge detection on a captured image 501 obtained by capturing an imaging region including the printed material 451, and the four corners 511 to 511 of the printed material region 521 that are images of the printed material 451 displayed on the captured image 501. By detecting 514, the printed material region 521 is extracted (see FIG. 8).

  Subsequently, the defect position specifying unit 413 performs a projective transformation that matches the printed product area 521 with the read image included in the defect information with respect to the extracted printed product region 521 to obtain a printed product region 531 after the projective conversion (FIG. 9). reference). As a result, the correspondence between the printed material region 521 and the read image is obtained. The correspondence relationship between the printed material region 521 and the read image is specifically a correspondence relationship between the position coordinates on the printed material region 521 and the position coordinates on the read image.

  Since the printed region 531 after the projective conversion coincides with the read image, the defect position specifying unit 413 converts the region on the read image indicated by the defect region coordinates included in the defect information on the printed region 531 after the projective conversion. The defect area 532 is specified (see FIG. 9). Note that the defect area coordinates used for specifying the defect area are the defect area coordinates associated with the defect No. determined by the determination unit 411 to exceed the threshold.

  Subsequently, the defect position specifying unit 413 reversely converts the printed matter area 531 after the projective conversion into the original printed matter area 521 using the correspondence relationship between the printed matter area 521 and the read image obtained earlier, and the printed matter after the projective conversion. By converting the defect area 532 on the area 531 into the area on the printed material area 521, the defect area 522 on the captured image is specified (see FIG. 10).

  The projection image generation unit 415 is based on the defect information when projected onto the projection area including the printed material based on the captured image acquired by the image acquisition unit 407 and the defect information acquired by the defect information acquisition unit 409. A projection image in which the above defect information image is associated with a defect on the printed material is generated.

  Specifically, when the defect position is specified by the defect position specifying unit 413, the projection image generating unit 415 corresponds to the position corresponding to the position of the defect on the captured image acquired by the image acquiring unit 407, or In association with the position, one or more defect information images are arranged to generate a projection image.

  This is because the printed matter is newly set in the projection device 400, the printed matter is reset in the projection device 400, or the printed matter set in the projection device 400 is moved, so that the defect information image is regarded as a defect on the printed matter. This is because a new projection image must be generated in order to associate them.

  Further, the projection image generation unit 415 may generate a projection image by further arranging a printed material information image based on the printed material information included in the defect information.

  The defect in which one or more defect information images are arranged is a defect for which the defect position is specified by the defect position specifying unit 413, that is, a defect of a defect No. that is determined by the determining unit 411 to exceed the threshold value. .

  For this reason, although the process itself for specifying a defect position was performed by the defect position specification part 413, since there was no defect determined that the threshold value was exceeded by the determination part 411, the defect position was not specified. Alternatively, the projection image generation unit 415 may generate the projection image by arranging the printed material information image without arranging one or more defect information images.

  On the other hand, when the defect position specifying unit 413 does not specify the position of the defect because the two printed product areas match, the projection image generation unit 415 does not generate a projection image. This is because the position of the printed material set on the projection device 400 has not changed and the printed material has not been moved, so that the previously generated projection image can be used.

  However, when the defect position specifying unit 413 does not specify the position of the defect because the printed region cannot be extracted from the captured image, the projection image generating unit 415 acquires the defect acquired by the defect information acquiring unit 409. A projection image based on the read image included in the information is generated. In this way, when the printed material is removed from the projection device 400, the read image is projected. Therefore, the read image can be projected in line with the printed material, and the user can compare the printed material with the read image.

  With reference to FIG. 11, a method for generating a projection image according to the present embodiment will be described. FIG. 11 is a diagram illustrating an example of the projection image 601 of the present embodiment.

  First, the projection image generation unit 415 prepares a blank image (undrawn image), and arranges (draws) one or more defect information images and printed material information images in the blank image to generate a projection image 601. To do. It is assumed that the size of the blank image, that is, the projected image 601 is the same as the size of the captured image 501 acquired by the image acquisition unit 407.

  In the example shown in FIG. 11, the projection image 601 is an image in which defect information images 631, 641, and 651 and a printed material information image 661 are arranged in a blank image. The defect information image 631 is an example of an image that emphasizes the position of the defect on the printed material, and the defect information image 641 is an example of an image obtained by enlarging the area on the read image indicated by the area information included in the defect information. The defect information image 651 is an example of an image indicating the content of the defect. However, the defect information image is not limited to these. Further, it is not necessary to arrange all of these images as one or more defect information images.

  In the example shown in FIG. 11, the defect information image 631 is a hollow rectangular frame. When the projected image 601 is projected onto a projection area including the printed material 451, the hollow rectangular frame is printed. A blank image is drawn so as to surround the defect on 451.

  Here, the correspondence between the printed region 521 on the captured image 501 and the read image is obtained by the defect position specifying unit 413, and the size of the blank image is the same as the size of the captured image 501. For this reason, the projection image generation unit 415 converts the defect area coordinates included in the defect information into coordinates on the blank image using this correspondence, and creates a margin in the rectangular frame specified by the converted coordinates. A frame provided with is drawn as a defect information image 631 on a blank image.

  The defect area coordinates used for drawing the defect information image 631 are the defect area coordinates of the defect for which the defect position is specified by the defect position specifying unit 413, that is, the defect number determined to exceed the threshold value by the determining unit 411. Is a defect area coordinate associated with.

  At this time, the projection image generation unit 415 may determine the color of the defect information image 631, that is, the color of the rectangular frame based on the color indicated by the color information of the defect area associated with the defect area coordinates. . For example, the projection image generation unit 415 may determine the complementary color of the color indicated by the color information as the color of the rectangular frame. In this way, the color of the rectangular frame can be made conspicuous with respect to the color of the area indicated by the defect area coordinates, and the position of the defect on the printed matter 451 can be more emphasized.

  The complementary color of the color indicated by the color information is, for example, the maximum value and the minimum value specified from the average values of R, G, and B indicated by the color information, and the sum of the specified maximum value and minimum value is determined. For each average value of R, G, and B, the average value is calculated by subtracting it from the calculated total value.

  Further, the projected image generation unit 415 may change the color of the defect information image 631 based on the switching operation from the operation unit 419 and draw the image.

  In the example shown in FIG. 11, the description has been given by taking a hollow rectangular frame as an example of an image that emphasizes the position of the defect on the printed material. However, if the image can emphasize the position of the defect on the printed material, the image is filled. Or a boundary line. These may be used properly according to the type of defect. For example, as detailed information, if the detailed information further correlating the emphasis information indicating the emphasis method as shown in FIG. 12 is adopted, and an image that emphasizes the position of the defect on the printed matter is drawn by the emphasis method indicated by the emphasis information. Good.

  According to the example shown in FIG. 12, in the case of a spot-like defect, the spot-like defect can be emphasized by surrounding it with a rectangular frame, and in the case of a stripe-like defect, it can be emphasized by painting with a streak. In this case, since the uneven area can be emphasized by the boundary line, the position of the defect on the printed matter 451 can be more emphasized by a method suitable for the type of defect.

  The defect information image 641 is an image obtained by enlarging the area on the read image indicated by the defect area coordinates. When the projection image 601 is projected onto the projection area including the print 451, the defect information image 641 is associated with the defect on the print 451. A blank image is drawn outside the printed matter area 621 so as to be projected outside the printed matter 451.

  Here, the printed region 521 on the captured image 501 is obtained by the defect position specifying unit 413, and the size of the blank image is the same as the size of the captured image 501. For this reason, the projection image generation unit 415 cuts out the area on the read image indicated by the defect area coordinates, specifies the print area 621 on the blank image from the print area 521 on the captured image 501, and then on the blank image. The image of the cut-out area is enlarged so as to fit in the area outside the printed material area 621, and is drawn as a defect information image 641 on a blank image.

  The defect area coordinates used for drawing the defect information image 641 are the defect area coordinates of the defect for which the defect position is specified by the defect position specifying unit 413, that is, the defect number determined by the determining unit 411 to exceed the threshold. Is a defect area coordinate associated with.

  At this time, the projection image generation unit 415 may further draw a scale or the like in order to make the user know the size of the defect. The scale width can be specified from the defect area coordinates. Further, the projection image generation unit 415 may draw the image by changing the enlargement ratio of the image obtained by enlarging the area on the read image indicated by the defect area coordinates based on the switching operation from the operation unit 419. When there are a plurality of defects whose defect positions have been specified by the defect position specifying unit 413, the projection image generation unit 415 switches and switches the defect to be enlarged image generation target based on the switching operation from the operation unit 419. You may make it draw the image which expanded the area | region on the read image which the defect area | region coordinate of a subsequent defect shows.

  The defect information image 651 is an image indicating a defect No and a defect level, and is drawn in the vicinity of the defect information images 631 and 641.

  The printed material information image 661 is an image showing a job, a copy, and a page, and when the projected image 601 is projected onto the printed material 451, the printed material information image 661 is drawn as a blank image so as to be projected onto an empty area.

  In addition, the projection image generation part 415 should just draw a reading image in a blank image, when generating the projection image based on a reading image. The drawing position of the read image with respect to the blank image may be an arbitrary position such as the center of the blank image.

  The projection unit 417 projects the projection image generated by the projection image generation unit 415 onto a projection area including a printed material. Specifically, every time the projection image generation unit 415 generates a projection image, the projection unit 417 projects the projection image onto the projection area.

  Thereby, if a printed material is set, a projected image is projected on the printed material, and if no printed material is set, a projected image on which a read image is drawn is projected.

  FIG. 13 is a diagram illustrating an example of a projection state according to the present embodiment. In the example shown in FIG. 13, the projection image 601 described with reference to FIG. 11 is projected onto the projection area including the printed material 451. Therefore, the defect information image 631 is projected onto the defect area 452 on the printed material 451, and the defect information image 641 is projected in association with the defect area 452.

  FIG. 14 is a flowchart illustrating an example of a flow of processing steps performed by the projection apparatus 400 according to the present embodiment.

  First, the receiving unit 401 receives a plurality of pieces of defect information from the printed matter inspection apparatus 200 and stores them in the storage unit 403 (step S201).

  Subsequently, when the user sets a printed material on the projection device 400 and performs an imaging start operation from the operation unit 419 (Yes in step S203), the imaging unit 405 images an imaging region including the printed material (step S205). . If the imaging start operation is not performed (No in step S203), the process returns to step S203.

  Subsequently, the image acquisition unit 407 acquires the captured image captured by the imaging unit 405 (step S207).

  Subsequently, the defect information acquisition unit 409 acquires defect information of the printed matter imaged by the imaging unit 405 from the storage unit 403 (step S209).

  Subsequently, the determination unit 411 determines whether the degree of each defect included in the defect information acquired by the defect information acquisition unit 409 exceeds a threshold (step S211).

  Subsequently, the defect position specifying unit 413 extracts a printed material area from the captured image acquired by the image acquiring unit 407 (step S213), and whether or not it matches the printed material region extracted from the previous captured image (both printed material regions). Whether or not the coordinates of the four corners coincide with each other) is determined (step S215).

  If the two printed material areas do not match (No in step S215), the defect position specifying unit 413 determines the correspondence between the printed material region extracted this time and the read image included in the defect information acquired by the defect information acquiring unit 409, and Using the defect area coordinates of the defect that is included in the defect information and determined to exceed the threshold by the determination unit 411, the position of the defect on the captured image is specified (step S217). If the two printed product areas match (Yes in step S215), the process proceeds to step S223.

  Subsequently, the projection image generation unit 415 specifies a position on the blank image corresponding to the position of the defect on the captured image specified by the defect position specification unit 413, and associates the position with the position or the position. One or more defect information images are drawn (step S219).

  The process of step S219 is repeated until the process of step S219 is performed for all the defects whose positions are specified in step S217 (No in step S219 and step S221).

  When the process of step S219 is performed on all the defects whose positions are specified in step S217 (Yes in step S221), the projection unit 417 projects the projection image generated thereby on the projection area including the printed matter. (Step S223).

  Subsequently, when the user does not perform an imaging end operation from the operation unit 419 (No in step S225), the process returns to step S205, and when the user performs an imaging end operation from the operation unit 419 (Yes in step S225). Return to step S203.

  As described above, in the present embodiment, since one or more defect information images based on the defect information are projected so as to be related to the defect on the printed material, the user can display the defect information image related to the defect on the printed material. And the user can easily check for defects present on the printed matter.

(Hardware configuration)
FIG. 15 is a block diagram illustrating an example of a hardware configuration of the printing apparatus 100 and the printed matter inspection apparatus 200 according to the present embodiment.

  As shown in FIG. 15, the printing apparatus 100 and the printed matter inspection apparatus 200 have a configuration in which a controller 910 and an engine unit (Engine) 960 are connected by a PCI bus. The controller 910 is a controller that controls the entire control of the printing apparatus 100 or the printed matter inspection apparatus 200, drawing, communication, and input from the operation display unit 920. The engine unit 960 is an engine that can be connected to a PCI bus. In the case of the printing apparatus 100, for example, a printer engine such as a black and white plotter, a one-drum color plotter, or a four-drum color plotter. A scanner engine such as a scanner. The engine unit 960 includes an image processing part such as error diffusion and gamma conversion in addition to the engine part.

  The controller 910 includes a CPU 911, a north bridge (NB) 913, a system memory (MEM-P) 912, a south bridge (SB) 914, a local memory (MEM-C) 917, and an ASIC (Application Specific Integrated Circuit). 916 and a hard disk drive (HDD) 918, and the North Bridge (NB) 913 and the ASIC 916 are connected by an AGP (Accelerated Graphics Port) bus 915. The MEM-P 912 further includes a ROM 912a and a RAM 912b.

  The CPU 911 performs overall control of the printing apparatus 100 or the printed matter inspection apparatus 200, has a chip set including the NB 913, the MEM-P 912, and the SB 914, and is connected to other devices via the chip set.

  The NB 913 is a bridge for connecting the CPU 911 to the MEM-P 912, SB 914, and the AGP bus 915, and includes a memory controller that controls reading and writing to the MEM-P 912, a PCI master, and an AGP target.

  The MEM-P 912 is a system memory used as a memory for storing programs and data, a memory for developing programs and data, a memory for drawing printers, and the like, and includes a ROM 912a and a RAM 912b. The ROM 912a is a read-only memory used as a memory for storing programs and data, and the RAM 912b is a writable and readable memory used as a program / data development memory, a printer drawing memory, and the like.

  The SB 914 is a bridge for connecting the NB 913 to a PCI device and a peripheral device. The SB 914 is connected to the NB 913 via a PCI bus, and a network interface (I / F) unit and the like are also connected to the PCI bus.

  The ASIC 916 is an IC (Integrated Circuit) for image processing having hardware elements for image processing, and has a role of a bridge for connecting the AGP bus 915, the PCI bus, the HDD 918, and the MEM-C 917, respectively. The ASIC 916 includes a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC 916, a memory controller that controls the MEM-C 917, and a plurality of DMACs (Direct Memory) that perform image data rotation by hardware logic and the like. Access Controller) and a PCI unit that performs data transfer between the engine unit 960 via the PCI bus. The ASIC 916 is connected to a USB 940 and an IEEE 1394 (the Institute of Electrical and Electronics Engineers 1394) interface (I / F) 950 via a PCI bus. The operation display unit 920 is directly connected to the ASIC 916.

  The MEM-C 917 is a local memory used as a copy image buffer and a code buffer, and the HDD 918 is a storage for storing image data, programs, font data, and forms.

  The AGP bus 915 is a bus interface for a graphics accelerator card proposed for speeding up graphics processing. The AGP bus 915 speeds up the graphics accelerator card by directly accessing the MEM-P 912 with high throughput. It is.

  Next, an example of a hardware configuration of the projection apparatus 400 according to the present embodiment will be described. The projection apparatus 400 according to the present embodiment communicates with a control device such as a CPU, a storage device such as a ROM and a RAM, an external storage device such as an HDD, a display device such as a display, and an input device such as a keyboard and a mouse. And a communication device such as an interface, and has a hardware configuration using a normal computer.

DESCRIPTION OF SYMBOLS 1 Printed product inspection apparatus 100 Printing apparatus 101 Operation panel 103Y, 103M, 103C, 103K Photosensitive drum 105 Transfer belt 107 Secondary transfer roller 109 Paper feed part 111 Conveyance roller pair 113 Fixing roller 115 Reverse path 121 RIP part 123 Print control part 125 Printing unit 200 Printed material inspection apparatus 201, 201A, 201B Reading unit 203 Acquisition unit 205 Master image generation unit 207 Buffer 209 Inspection unit 211 Storage unit 300 Stacker 400 Projection device 401 Reception unit 403 Storage unit 405 Imaging unit 407 Image acquisition unit 409 Defect information Acquisition unit 411 determination unit 413 defect position specification unit 415 projection image generation unit 417 projection unit 419 operation unit 910 controller 911 CPU
912 System memory 912a ROM
912b RAM
913 North Bridge 914 South Bridge 915 AGP Bus 916 ASIC
917 Local memory 918 Hard disk drive 920 Operation display unit 940 USB
950 IEEE1394 interface 960 engine part

JP 2011-112430 A

Claims (10)

An image acquisition unit for acquiring a captured image obtained by imaging a printed matter having a defect;
A defect information acquisition unit for acquiring defect information relating to defects present on the printed matter;
Based on the captured image and the defect information, one or more defect information images based on the defect information generate a projection image associated with the defect on the printed material when projected onto a projection area including the printed material. A projection image generation unit;
A projection unit that projects the projection image onto the projection area;
A projection apparatus comprising: The defect information includes a read image obtained by electronically reading the printed matter, region information indicating a region of the defect present on the read image, and content information indicating the content of the defect,
A defect position that extracts a printed material area that is an area of the printed material from the captured image, and identifies the position of the defect on the captured image using the correspondence between the printed material area and the read image and the region information. Further comprising a specific part,
2. The projection image generation unit generates the projection image by arranging the one or more defect information images in association with a position corresponding to the position of the defect on the captured image or in association with the position. The projection apparatus described in 1. The defect information further includes printed matter information related to the printed matter,
The projection apparatus according to claim 2, wherein the projection image generation unit further arranges a printed material information image based on the printed material information to generate the projection image.   4. The projection apparatus according to claim 2, wherein any one of the one or more defect information images is an image that emphasizes a position of the defect on the printed matter. The defect information further includes color information indicating a color of the defect area,
The projection apparatus according to claim 4, wherein the projection image generation unit determines a color of an image that emphasizes a position of the defect on the printed material based on a color indicated by the color information.   4. The projection apparatus according to claim 2, wherein one of the one or more defect information images is an image obtained by enlarging an area on the read image indicated by the area information. 5.   The projection apparatus according to claim 4, wherein any one of the one or more defect information images is an image showing a content of the defect. The content information indicates at least the degree of the defect,
A determination unit for determining whether the degree of the defect exceeds a threshold;
The projection image generation unit generates the projection image in which the one or more defect information images are associated with the defect on the printed material when the degree of the defect exceeds the threshold value. The projection apparatus as described in one.   The projection apparatus according to claim 2, wherein the projection image generation unit generates a projection image based on the read image when an area of the printed material is not extracted from the captured image. An image acquisition step of acquiring a captured image obtained by imaging a printed matter having a defect;
A defect information acquisition step of acquiring defect information relating to defects present on the printed matter;
Based on the captured image and the defect information, one or more defect information images based on the defect information generate a projection image associated with the defect on the printed material when projected onto a projection area including the printed material. A projection image generation step;
A projecting step of projecting the projected image onto the projection area;
A projection method including:

Images