JP2017034381A - Image processing apparatus, image processing system, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve determination accuracy at the time of determining the existence of a printed matter at a discharge position.SOLUTION: An image reception unit 203 of an image processing device 102 acquires an image obtained by imaging a discharge position of a printed matter of a printer 101 with an imaging device 103. A determination unit 204 determines whether or not the printed matter exists at the discharge position on the basis of the image imaged after the determination that is acquired by an image reception unit 203 when determining that the printed matter is static at the discharge position. An output unit 205 outputs information on the existence of the printed matter at the discharge position in accordance with the determination result of the determination unit 204.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing system for determining the presence or absence of printed matter.

  2. Description of the Related Art Conventionally, a technique for determining whether or not a printed material is present in a discharge unit of the printing device is known in order to prevent misplacement of the printed material in a printing apparatus such as a copying machine.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses that a printing apparatus and its vicinity are imaged, and whether or not a printed matter is present on a discharge stand of the printing apparatus is determined based on an image obtained by the imaging. Specifically, the information processing apparatus described in Patent Literature 1 stores an image captured when it is determined that printing in the printing apparatus is completed as a background image, and an image captured after that and a background image The difference is calculated. If the difference is large, it is determined that the printed material does not exist. If the difference is small, it is determined that the printed material exists.

JP 2009-141585 A

  However, when determining the presence or absence of a printed matter at the discharge position based on the captured image, there is a problem that the determination accuracy is lowered depending on the state of the printed matter at the time of imaging. For example, when performing a determination using the method described in Patent Document 1, if the printed material after printing is not immediately stopped at the discharge position, an image captured until the printed material is stopped is stored as a background image. There is. In this case, the presence or absence of the printed matter cannot be accurately determined from the difference between the image captured thereafter and the background image.

  In view of the above problems, an object of the present invention is to provide a technique for improving the determination accuracy when determining the presence or absence of printed matter at a discharge position.

  In order to solve the above problems, an image processing apparatus according to the present invention has, for example, the following configuration. That is, an acquisition unit that acquires an image captured by the imaging device with respect to a discharge position of the printed material by the printing device, a first determination unit that determines whether the printed material is stationary at the discharge position, and the printed material is the discharge position. When the first determination unit determines that the print is stationary in step S1, the first determination unit determines whether the printed matter is present at the discharge position based on an image acquired by the acquisition unit and captured after the determination. 2 determination means and output means for outputting information relating to the presence or absence of the printed matter at the discharge position according to the determination result by the second determination means.

  ADVANTAGE OF THE INVENTION According to this invention, the determination precision at the time of determining the presence or absence of the printed matter in a discharge position can be improved.

1 is a diagram illustrating a configuration example of an image processing system according to an embodiment. It is a block diagram which shows the hardware structural example of the image processing apparatus 102 based on embodiment. It is a block diagram which shows the function module structural example of the image processing system which concerns on embodiment. 6 is a flowchart for explaining the overall operation of the image processing apparatus according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiments do not limit the present invention according to the scope of claims, and all combinations of features described in the following embodiments are not necessarily essential to the present invention.

[System configuration]
FIG. 1 is a diagram illustrating a configuration example of an image processing system. The image processing system includes a printing apparatus 101, an image processing apparatus 102, and an imaging apparatus 103. The image processing apparatus 102 is connected to the printing apparatus 101 and the imaging apparatus 103 to perform communication. Note that these devices may be wired or wirelessly connected. These devices may be directly connected or may be connected via other devices. In this embodiment, the case where the printing apparatus 101, the image processing apparatus 102, and the imaging apparatus 103 are configured as separate apparatuses will be mainly described, but the present invention is not limited thereto. For example, any two of these three devices may be configured integrally, or all three devices may be configured integrally.

  Specific examples of the printing apparatus 101 that prints and discharges printed matter include a printer, a copier, and a digital multifunction machine that print on paper using ink or toner. In this embodiment, the printing apparatus 101 may be a 3D printer, and three-dimensional modeling by the 3D printer is also called printing. Hereinafter, a printing apparatus including a printer that prints on a sheet and a 3D printer is simply referred to as a printer. Specific examples of the image processing apparatus 102 include a PC and a server apparatus. The imaging device 103 images the imaging range 104. In this embodiment, the case where the imaging apparatus 103 captures a moving image will be mainly described. However, the present invention is not limited to this. For example, the imaging apparatus 103 may capture a still image at regular intervals. Specific examples of the imaging device 103 include a digital camera and a network camera. The imaging range 104 is a range that is imaged by the imaging device 103, and is set to a range that includes a discharge position of the printed material by the printing device 101 in this embodiment. In the present exemplary embodiment, the position where the printed material is discharged is the discharge tray provided in the printing apparatus 101, but is not limited thereto. For example, a printed matter printed by the printing apparatus 101 may be transported by an apparatus outside the printing apparatus 101 and discharged to a discharge position away from the printing apparatus 101.

  Here, for example, an application example of the technique according to the present embodiment when the printing apparatus 101 is a printer, the image processing apparatus 102 is a PC, and the imaging apparatus 103 is a network camera will be described. First, the user operates the PC to instruct the printer to print. Upon receiving the instruction, the printer performs printing, and notifies the PC when printing is completed. The PC that has received the notification receives the image from the network camera, and determines whether or not the printed material is discharged to the printer's discharge tray and stopped based on the image. If it is determined that the printed material is stationary, the PC determines the presence or absence of the printed material in the discharge tray based on the change in the captured image after the stationary determination received from the network camera. Then, the PC notifies an information terminal (not shown) such as a smartphone owned by the user that the printed matter is left or taken away according to the determination result.

  In this way, by using the image captured by the network camera, the PC can determine the presence or absence of the printed material in the discharge tray even when the printer does not have a mechanism such as a sensor for detecting the printed material. In addition, when a plurality of printers are installed in a range that can be imaged by the network camera, the PC determines the presence / absence of printed matter in the discharge trays of the plurality of printers based on an image captured by one network camera. You can also.

  Next, components of the image processing apparatus 102 will be described in detail. FIG. 2 is a block diagram illustrating a hardware configuration example of the image processing apparatus 102. The image processing apparatus 102 includes a CPU 301, a ROM 302, a RAM 303, an auxiliary storage device 304, a display unit 305, an operation unit 306, and a communication unit 307, which are mutually connected by a bus.

  The CPU 301 controls the entire image processing apparatus 102. The ROM 302 stores programs and parameters that do not need to be changed. The RAM 303 temporarily stores programs and data supplied from the auxiliary storage device 304 or the like. The auxiliary storage device 304 is configured by a hard disk drive device, for example, and stores content data such as still images and moving images, programs, and the like. The display unit 305 includes a liquid crystal display, for example, and displays a GUI (Graphical User Interface) for the user to operate the image processing apparatus 102. The operation unit 306 includes, for example, a keyboard and a mouse, and inputs various instructions to the CPU 301 in response to user operations. The communication unit 307 is connected to a network such as a LAN or the Internet and other devices such as a printer or a network camera, and transmits and receives various information. In the present embodiment, the display unit 305 and the operation unit 306 exist inside the image processing apparatus 102, but at least one of the display unit 305 and the operation unit 306 exists as another apparatus outside the image processing apparatus 102. May be.

[Function module configuration]
FIG. 3 is a block diagram illustrating a functional module configuration example of the image processing system. The printing apparatus 101 includes a printing unit 200 and a print event transmission unit 201 (hereinafter, event transmission unit 201). The image processing apparatus 102 includes a print event reception unit 202 (hereinafter, event reception unit 202), an image reception unit 203, a determination unit 204, and an output unit 205. The imaging device 103 includes an image transmission unit 206 and an imaging unit 207. Each module of the image processing apparatus 102 is realized by the CPU 301 expanding and executing a program stored in the ROM 302 on the RAM 303. Further, for example, when processing by hardware is performed as an alternative to software processing using the CPU 301, an arithmetic unit or a circuit corresponding to the processing of each module described here may be configured. Note that it is not essential that the image processing system includes all of the above modules.

The printing unit 200 prints a printed matter and discharges it to a discharge tray in response to a print request from the user. The print request may be directly input by the user by operating an operation unit (not shown) provided in the printing apparatus 101, for example, or the printing apparatus 101 receives a print request transmitted from the image processing apparatus 102 or other apparatus. You may receive it. When the printing unit 200 completes printing, the event transmission unit 201 transmits print event information, which is information indicating completion of printing, to the event reception unit 202. Note that the print event information is not limited to information indicating completion of printing, but may include information for notifying the execution state of printing. For example, the print event information is information indicating the start of printing, and the event transmission unit 201 may transmit the print event information when the printing unit 200 starts printing.
The image processing apparatus 102 according to the present embodiment determines whether or not the printed material is stationary at the discharge position based on images captured after the time point when the print event information is received. Therefore, when the print event information is transmitted when printing is completed, the image processing apparatus 102 can make a determination using a captured image of a short period. However, for example, if the user pulls out and removes the printed material immediately before the printing apparatus 101 completes printing, the image processing apparatus 102 cannot make a correct determination. On the other hand, when the print event information is transmitted at the start of printing, the image processing apparatus 102 can also detect that the printed matter is pulled out during printing. Must be used for judgment.
The event reception unit 202 receives print event information transmitted from the event transmission unit 201 of the printing apparatus 101. Then, the event receiving unit 202 recognizes the print execution state in the printing apparatus 101 based on the print event information, and transmits the print execution state to the determination unit 204. For example, when the event receiving unit 202 receives print event information indicating the start of printing, the event receiving unit 202 recognizes that printing is being executed in the printing apparatus 101. When print event information indicating completion of printing is received, the printing apparatus 101 recognizes that printing has been completed. In the present exemplary embodiment, the case where the image processing apparatus 102 recognizes the printing state of the printing apparatus 101 based on the print event information is mainly described, but the present invention is not limited thereto. For example, the image processing apparatus 102 may recognize the printing execution state in the printing apparatus 101 based on the image acquired from the imaging apparatus 103. The image reception unit 203 acquires an image captured by the imaging device 103 from the image transmission unit 206 and transmits the acquired image to the determination unit 204.

  The determination unit 204 receives print event information from the event transmission unit 201 and receives an image from the image reception unit 203. Then, the determination unit 204 determines whether or not the printed matter has stopped at the discharge position based on the print execution state recognized by the event reception unit 202 and the image acquired by the image reception unit 203. In the present embodiment, the state in which the printed material is determined to be stationary at the discharge position is a state in which the printed material is stored in the discharge tray and the variation in the position and shape of the printed material is less than a certain level.

  Specifically, a plurality of images captured by the imaging device 103 at a plurality of points in time after the event receiving unit 202 recognizes that printing in the printing apparatus 101 has been completed or is being executed. Is acquired by the image receiving unit 203. Based on the difference between the plurality of images, the determination unit 204 determines whether the printed material has stopped at the discharge position. In particular, the determination unit 204 in the present embodiment analyzes a plurality of frames included in the moving image acquired by the image receiving unit 203, and calculates an image change amount from the inter-frame difference of the moving image. Then, the determination unit 204 determines that the printed matter has stopped on the discharge tray when the amount of change in the image between frames becomes less than a certain amount. However, if the amount of change in the image between frames does not become less than a predetermined value within a predetermined period, or if the amount of change in the image between frames is greater than a predetermined threshold, the determination unit 204 determines that the printed matter is It is determined that the discharge tray has not stopped. This corresponds to, for example, a case where the printed matter is taken away before it stops in the discharge tray.

  Note that the method by which the determination unit 204 determines whether the printed material is stationary is not limited to this, and other methods may be used. For example, the determination unit 204 may perform the determination based on the amount of change in the partial area in which the discharge position is captured in the image acquired by the image reception unit 203, or may perform the printing recognized by the event reception unit 202. The determination may be made without using the state. The determination unit 204 may start the determination process after a predetermined time has elapsed since the event reception unit 202 received the print event information. For example, if the printing apparatus 101 has not yet started the discharge of the printed material when the print event information is received, the image processing apparatus 102 waits until the discharge of the printed material starts and then starts the determination. Thereby, it can suppress that the state in which the printed matter is not yet discharged is erroneously determined as the state in which the printed matter is stationary at the discharge position. In addition, the determination unit 204 uses an image captured by the imaging device 103, for example, when the predetermined time has elapsed since the event reception unit 202 received the print event information, and the printed material is stationary. Alternatively, the stillness determination may be performed.

  Further, when the determination unit 204 determines that the printed material is stationary at the discharge position, the determination unit 204 determines whether or not the printed material is present at the discharge position based on the image captured after the stationary determination acquired by the image receiving unit 203. judge. Specifically, when the determination unit 204 determines that the printed material has stopped at the discharge position, the image reception unit 203 acquires a plurality of images captured by the imaging device 103 at a plurality of discharge positions after the determination. To do. Then, the determination unit 204 determines whether there is a printed material at the discharge position based on the difference between the plurality of images.

  In particular, in the present embodiment, the determination unit 204 determines that there is no printed matter at the discharge position when a parameter corresponding to the degree of difference between a plurality of frames included in the moving image acquired by the image reception unit 203 is equal to or greater than a predetermined value. judge. In addition, the determination unit 204 determines that a printed matter exists at the discharge position when the parameter is less than a predetermined value. For example, the determination unit 204 sets, as a background image, a frame corresponding to a time point determined to be stationary at the position where the printed matter is included, included in the moving image acquired by the image reception unit 203. Then, in each frame corresponding to the subsequent time point, the determination is performed using as a parameter the number of pixels in which the difference in pixel values is a certain value or more compared to the background image. Note that the method for determining whether or not the printed material is present at the discharge position is not limited to this. For example, the determination unit 204 changes the partial area in which the discharge position is captured in the image acquired by the image reception unit 203. The determination may be made based on the amount.

  The output unit 205 outputs information related to the presence or absence of the printed material at the discharge position according to the result determined by the determination unit 204. The output unit 205 in the present embodiment indicates information regarding the presence or absence of the printed material at the discharge position (for example, indicating that the printed material is left) when the determination unit 204 determines that the printed material has existed at the discharge position for a period longer than a predetermined length. Information). In addition, when the determination unit 204 determines that there is no printed material at the discharge position, the output unit 205 outputs information related to the presence or absence of the printed material at the discharge position (for example, information indicating the removal of the printed material). However, the content and output timing of the information output by the output unit 205 are not limited to this. For example, the output unit 205 may periodically or continuously output information indicating whether or not a printed material exists at the discharge position.

  The output unit 205 in the present embodiment outputs information regarding the presence or absence of printed matter at the discharge position to an information terminal (not shown) connected to the image processing apparatus 102 via a network. The information terminal is an apparatus used by a user such as a PC or a smart device. The user who owns the information terminal can notice whether the printed material is left or taken away by the output information. Note that if the image processing apparatus 102 manages information that identifies the information terminal of the user who has issued a print instruction to the printing apparatus 101, the image processing apparatus 102 notifies only the user who has issued the print instruction information regarding the presence or absence of the printed matter at the discharge position. can do. Further, the image processing apparatus 102 may have a function of specifying a person who has taken away a printed material, for example, by processing for extracting and identifying a face image from an image received by the image receiving unit 203. When the image processing apparatus 102 has such a function, the image processing apparatus 102 can notify the removal of the printed material only when the person who has removed the printed material does not match the user who issued the print instruction.

  Note that the output destination of information by the output unit 205 is not limited to this. For example, the output unit 205 outputs information to a display unit 305 and an audio output unit (not shown) provided in the image processing apparatus 102, and the image processing apparatus 102 notifies the user of the occurrence of leaving or taking away the printed matter by display or audio. May be. Further, for example, the output unit 205 may transmit information to the printing apparatus 101, and the printing apparatus 101 may notify the user of the occurrence of leaving or taking away the printed matter by display or voice.

  The image transmission unit 206 transmits the image captured by the imaging unit 207 to the image reception unit 203. The image capturing unit 207 captures an output position of the printed material by the printing apparatus 101.

[Operation flow]
FIG. 4 is a flowchart for explaining the entire operation of the image processing apparatus 102. The process of FIG. 4 is started at the timing when the image processing apparatus 102 is activated, for example. However, the start timing of the process in FIG. 4 is not limited to the above timing.

  In step S <b> 101, the event reception unit 202 waits for reception of print event information transmitted from the printing apparatus 101, and recognizes a printing execution state in the printing apparatus 101 based on the received print event information. In step S <b> 102, the image reception unit 203 receives and acquires an image obtained by the imaging device 103 capturing the print output discharge position by the printing apparatus 101 from the image transmission unit 206.

  In step S <b> 103, the determination unit 204 performs a process of determining whether the printed material has stopped at the discharge position. The determination unit 204 in the present embodiment calculates an image change amount from the inter-frame difference in the moving image received by the image reception unit 203 in S102. When the change amount of the image between frames does not become less than a certain value within a predetermined period or when a change amount greater than a predetermined threshold value is detected between frames, the determination unit 204 stops the printed matter at the discharge position. It determines with having not carried out (S103; No) and complete | finishes a process. On the other hand, when the amount of change in the image between frames becomes less than a certain amount within a predetermined period, the determination unit 204 determines that the printed matter is stationary at the discharge position (S103; Yes), and proceeds to S104.

  In step S <b> 104, the determination unit 204 determines whether there is a printed material at the discharge position based on the image acquired by the image reception unit 203 in step S <b> 102. In the present embodiment, the determination unit 204 calculates the amount of image change using the background difference in the moving image received by the image reception unit 203 in S102. At this time, the determination unit 204 sets a frame of a moving image corresponding to the time point when it is determined in step S103 that the printed material is stationary at the discharge position, and compares the frame corresponding to the subsequent time point with the background image. Then, the determination unit 204 determines that there is a printed material for a frame whose image change amount is less than a predetermined value, and for a frame whose image change amount is a predetermined value or more, the printed material. Is determined not to exist.

  In step S <b> 105, the output unit 205 outputs information related to the presence / absence of the printed material at the discharge position according to the result determined by the determination unit 204 in step S <b> 104. The output unit 205 according to the present embodiment outputs detection event information indicating that the printed material has been left out when the determining unit 204 determines that the printed material exists at the discharge position for a period longer than the predetermined length in S104. Output to the information terminal. On the other hand, if it is determined in S104 that no printed material exists at the discharge position, detection event information indicating that the printed material has been taken away is output to an external information terminal. However, the present invention is not limited to this. For example, the output unit 205 may output detection event information for either leaving or taking away, or may output other information.

  In step S <b> 106, the determination unit 204 determines whether to stop the process of determining the presence or absence of a printed material. If the output unit 205 outputs information about leaving the printed material in S105, the determination unit 204 in the present embodiment does not stop the determination process (S106; No) and returns to S104. On the other hand, when the output unit 205 outputs information related to the removal of the printed material in S105, the determination unit 204 stops the determination process (S106; Yes) and proceeds to S107. However, the present invention is not limited to this. For example, the determination unit 204 may determine to stop the determination process based on other conditions, or may always stop the determination process.

  In step S107, the image processing apparatus 102 determines whether to stop the operation. If the image processing apparatus 102 does not stop the operation (S107; No), the process returns to S101, the event receiving unit 202 waits for the reception of new print event information, and if the operation stops (S107; Yes), the process is performed. Exit. Whether the image processing apparatus 102 stops operating may be determined according to the state of the printing apparatus 101, for example, or may be selected by the user.

  As described above, the image processing apparatus 102 according to the present exemplary embodiment acquires an image captured by the imaging apparatus 103 at the printed material discharge position of the printing apparatus 101 and determines whether the printed material is stationary at the discharge position. Further, when the image processing apparatus 102 determines that the printed matter is stationary at the discharge position, the image processing apparatus 102 determines whether or not the printed matter exists at the discharge position based on the image acquired after the stationary determination acquired from the imaging device 103. judge. Further, the image processing apparatus 102 outputs information related to the presence / absence of printed matter at the discharge position according to the determination result. Thereby, the image processing apparatus 102 can improve the determination accuracy when determining the presence or absence of the printed matter at the discharge position. Furthermore, the image processing apparatus 102 can notify the user that, for example, the printed material is left at the discharge position or removed from the discharge position, according to the determination result. As a result, it is possible to improve the convenience of the user who performs printing with the printing apparatus 101.

  In addition, the image processing apparatus 102 according to the present embodiment recognizes a printing execution state in the printing apparatus 101, and determines whether or not the printed matter has stopped at the discharge position based on the printing execution state and the image acquired from the imaging apparatus 103. Determine. As a result, the image processing apparatus 102 can determine whether or not the printed matter has stopped at the discharge position based on, for example, images captured after the time point when the completion of printing is recognized. As a result, it is possible to determine whether or not the printed matter has stopped at the discharge position more efficiently than when the determination is made based only on the image acquired from the imaging device 103.

  Note that, in the present embodiment, the case where the image processing apparatus 102 acquires an image captured after the time point when the printing apparatus recognizes that printing has been completed from the imaging apparatus 103 is mainly described. However, the present invention is not limited to this, and the image processing apparatus 102 may always acquire images captured by the imaging apparatus 103 and extract and use images necessary for determination processing from these images.

  Further, in the present embodiment, the case where the image processing apparatus 102 determines that the printed material has not stopped at the discharge position has been described focusing on the case where the processing is terminated without determining whether the printed material is present at the discharge position. However, the present invention is not limited to this, and the output unit 205 may output information indicating that the printed material has not stopped when it is determined that the printed material has not stopped at the discharge position. In this way, the user can quickly know whether or not the printed matter has stopped at the discharge position.

  In the above description, the case where the image processing apparatus 102 determines whether or not a printed material exists at the discharge position based on the difference between a plurality of images captured by the imaging apparatus 103 has been mainly described. According to this method, there is a difference in the images captured by the imaging device 103 before and after the printed matter is taken away, so that the image processing device 102 can detect that the printed matter is removed and no longer exists at the discharge position. . However, the method by which the image processing apparatus 102 determines whether or not a printed material is present at the discharge position is not limited to this. When the determination by the above method is performed, even when an external impact is applied to the imaging apparatus 103 and the imaging range 104 is changed, a difference occurs in the captured image. Therefore, the image processing apparatus 102 erroneously determines that the printed matter has been taken away. There is a possibility that. Therefore, for example, the image processing apparatus 102 may acquire information regarding the printed material and determine whether or not the printed material exists at the discharge position based on the information and the image captured by the imaging device 103. Hereinafter, the operation of the image processing apparatus 102 in this case will be described in detail.

  When the printing unit 200 completes printing, the event transmission unit 201 transmits information related to the printed matter to the event reception unit 202 in addition to the print event information. Then, the event reception unit 202 acquires these pieces of information in S101 of FIG. The information related to the printed material in the present embodiment includes information related to the feature points of the image printed on the printed material. However, the present invention is not limited thereto, and the information related to the printed material may include, for example, the size and shape of the printed material, the color of the printing medium, image data printed on the printing medium, a part of the data, and the like. In the present embodiment, the case where the image processing apparatus 102 acquires information related to the printed matter from the printing apparatus 101 will be mainly described, but the present invention is not limited to this. For example, when the image processing apparatus 102 instructs the printing apparatus 101 to print, the image processing apparatus 102 has information about the printed matter itself, and the printed matter is placed at the discharge position based on this information and the image acquired from the imaging device 103. It may be determined whether or not exists.

  In S104 of FIG. 4, the determination unit 204 determines whether there is a printed material at the discharge position based on the information acquired by the image receiving unit 203 and the information regarding the printed material acquired by the event receiving unit 202. Specifically, the determination unit 204 relates to the feature points extracted from the image acquired by the image receiving unit 203 and the feature points of the image printed on the printed material included in the information acquired by the event receiving unit 202. Compare with information. Then, based on the result, it is determined whether or not a printed material is present at the discharge position. For example, if the difference between the feature amounts regarding these feature points is less than a predetermined value, the print surface of the printed matter discharged at the discharge position is likely to be included in the imaging range 104 of the imaging device 103, and thus the discharge is performed. It is determined that the printed material exists at the position. On the other hand, if the difference between the feature amounts regarding these feature points is equal to or greater than a predetermined value, it is determined that no printed matter exists at the discharge position. As a method for extracting feature points from an image, for example, existing methods such as SIFT (Scale Invariant Feature Transform) and SURF (Speeded Up Robust Features) can be used.

  Note that the method by which the determination unit 204 performs determination based on information on the printed material is not limited to this. For example, when the size or shape of the printed matter is included in the information about the printed matter, the printed matter is determined based on whether the size or shape of the printed matter recognized from the image acquired by the image receiving unit 203 matches the information. You may determine whether it exists in a discharge position. Further, for example, when image data to be printed on a print medium is included in the information related to the printed material, the determination unit 204 determines whether or not the image of the printed material acquired by the image receiving unit 203 matches the information. It may be determined whether the printed material is present at the discharge position.

  As described above, the image processing apparatus 102 according to the present embodiment acquires information about a printed material, and determines whether or not a printed material exists at the discharge position based on the image acquired from the imaging device 103 and the information about the printed material. can do. As a result, the image processing apparatus 102 can determine whether or not a printed matter exists at the discharge position with higher accuracy than in the case where the determination is made based only on the image acquired from the imaging apparatus 103.

  Note that the image processing apparatus 102 according to the present embodiment determines that the printed material is stationary at the discharge position based on the printing state of the printing apparatus 101 and the image acquired from the imaging device 103. Determine if it exists. However, the present invention is not limited to this. For example, the image processing apparatus 102 may determine whether or not the printed material has stopped at the discharge position based on information about the printed material and the image acquired from the imaging device 103. Further, when it is determined whether or not a printed material is present at the discharge position based on the information regarding the printed material and the image acquired from the imaging device 103, the printed material is stationary at the time of determination as compared with the case where the information regarding the printed material is not used. Misjudgment is not likely to occur. Therefore, in this case, the image processing apparatus 102 does not have to determine whether or not the printed material is stationary at the discharge position.

<Other embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions. Further, the program may be provided by being recorded on a computer-readable recording medium.

DESCRIPTION OF SYMBOLS 101 Printing apparatus 102 Image processing apparatus 103 Imaging apparatus 203 Image receiving part 204 Determination part 205 Output part

Claims (16)

An acquisition means for acquiring an image captured by the image capturing apparatus at a discharge position of the printed matter by the printing apparatus;
First determination means for determining whether or not the printed matter is stationary at the discharge position;
Whether the printed matter exists at the discharge position based on an image captured by the acquisition unit and acquired after the determination when the first determination unit determines that the printed matter has stopped at the discharge position. Second determination means for determining whether or not,
An image processing apparatus comprising: output means for outputting information relating to the presence or absence of the printed matter at the discharge position in accordance with a determination result by the second determination means. Recognizing means for recognizing the state of printing in the printing apparatus;
The first determination unit is configured to determine whether or not the printed matter is stationary at the discharge position based on a printing execution state recognized by the recognition unit and an image acquired by the acquisition unit. Item 8. The image processing apparatus according to Item 1. The acquisition unit acquires a plurality of images captured by the imaging device at a plurality of time points after the time point when the recognition unit recognizes that printing in the printing apparatus is being executed or completed. And
3. The image according to claim 2, wherein the first determination unit determines whether or not the printed matter is stationary at the discharge position based on a difference between the plurality of images acquired by the acquisition unit. Processing equipment. When the first determination unit determines that the printed matter is stationary at the discharge position, the acquisition unit acquires a plurality of images captured by the imaging device at the discharge position at a plurality of time points after the determination. ,
The said 2nd determination means determines whether the said printed matter exists in the said discharge position based on the difference of the said some image which the said acquisition means acquired. The image processing apparatus according to claim 1.   5. The output unit according to claim 1, wherein when the second determination unit determines that the printed matter does not exist at the discharge position, the output unit outputs information regarding the presence / absence of the printed matter at the discharge position. The image processing apparatus according to any one of the above.   The output means outputs information relating to the presence or absence of the printed matter at the discharge position when the second determining means determines that the printed matter is present at the discharge position for a period longer than a predetermined length. The image processing apparatus according to claim 1, wherein the image processing apparatus is characterized.   The image processing apparatus according to claim 2, wherein the recognition unit recognizes a printing execution state in the printing apparatus based on information indicating start or completion of printing transmitted from the printing apparatus.   8. The information output device according to claim 1, wherein the output unit outputs information related to the presence or absence of the printed matter at the discharge position to an information terminal connected to the image processing apparatus via a network. The image processing apparatus described. Second acquisition means for acquiring information relating to the printed matter;
The second determination unit determines whether the printed matter is present at the discharge position based on an image acquired by the acquisition unit and information acquired by the second acquisition unit. The image processing apparatus according to any one of 1 to 8.   The information related to the printed matter includes at least one of the size of the printed matter, the shape of the printed matter, the color of the print medium, the image data printed on the print medium, and the information on the feature points of the image. The image processing apparatus according to claim 9.   The second determination unit includes information on feature points extracted from the image acquired by the acquisition unit, and information on feature points of an image printed on a print medium included in the information acquired by the second acquisition unit. The image processing apparatus according to claim 9, wherein the image processing apparatus determines whether or not the printed matter is present at the discharge position based on a result obtained by comparing the two. A printing device for discharging printed matter;
An imaging device for imaging a discharge position of a printed matter by the printing device;
An image processing apparatus,
The image processing device includes an acquisition unit that acquires an image captured by the imaging device;
First determination means for determining whether or not the printed matter is stationary at the discharge position;
Whether the printed matter exists at the discharge position based on an image captured by the acquisition unit and acquired after the determination when the first determination unit determines that the printed matter has stopped at the discharge position. Second determination means for determining whether or not,
An image processing system comprising: output means for outputting information relating to the presence or absence of the printed matter at the discharge position in accordance with a determination result by the second determination means. The image processing apparatus has a recognition unit for recognizing a printing execution state in the printing apparatus,
The first determination unit is configured to determine whether or not the printed matter is stationary at the discharge position based on a printing execution state recognized by the recognition unit and an image acquired by the acquisition unit. Item 13. The image processing system according to Item 12. An acquisition step of acquiring an image taken by the imaging device of the discharge position of the printed matter by the printing device;
A first determination step of determining whether or not the printed matter is stationary at the discharge position;
When it is determined in the first determination step that the printed matter is stationary at the discharge position, the printed matter is present at the discharge position based on an image acquired after the determination and acquired in the acquisition step. A second determination step for determining whether or not to do;
And an output step of outputting information relating to the presence or absence of the printed matter at the discharge position in accordance with the determination result in the second determination step. A recognition step of recognizing a printing execution state in the printing apparatus;
In the first determination step, it is determined whether or not the printed matter has stopped at the discharge position based on the printing execution state recognized in the recognition step and the image acquired in the acquisition step. The image processing method according to claim 1.   A program for causing a computer to operate as the image processing apparatus according to any one of claims 1 to 11.

Images