WO2024204864A1 - Job content generation device and job content generation program - Google Patents

Abstract

This job content generation device for generating, on the basis of voice data indicating voice received by a smart speaker, job content to be executed by an image formation device corrects at least one of a plurality of setting values in the job content if the plurality of setting values in the job content are a combination such that these setting values cannot be simultaneously set, so that the resulting combination of a plurality of setting values in the job content can be simultaneously set (S73).

Description

JOB CONTENT GENERATION DEVICE AND JOB CONTENT GENERATION PROGRAM

The present invention relates to a job content generation device and a job content generation program that generate the content of a job to be executed by an image forming device based on voice data representing voice received by a voice receiving device that receives voice input from a user.

　Conventionally, there is known a voice operation system that operates an image forming apparatus via a smart speaker as a voice reception device (see, for example, Patent Document 1). In the voice operation system described in Patent Document 1, when job contents are generated based on voice data indicating voice received by the smart speaker, if the generated job contents cannot be executed by the image forming apparatus, an error is notified from the smart speaker.

JP 2021-051416 A

However, in the voice operation system described in Patent Document 1, if the content of a job generated based on voice data representing a voice received by the smart speaker is one that cannot be executed by the image forming device, the smart speaker always notifies the user of an error, which is a problem that cannot be said to be very convenient for the user.

The present invention aims to provide a job content generation device and a job content generation program that can improve convenience.

A job content generation device according to one aspect of the present invention is a job content generation device that generates the content of a job to be executed by an image forming device based on voice data representing voice received by a voice receiving device, and includes a processor, and a control unit that functions as a job content generation unit that, when multiple setting values in the content are a predetermined combination that cannot be set simultaneously, corrects at least one of the multiple setting values in the content to a setting value that is a predetermined combination that can be set simultaneously by executing a job content generation program.

With this configuration, the job content generation device according to one aspect of the present invention can improve convenience by automatically correcting at least one of the multiple setting values in the job content when the multiple setting values in the job content are combined in a way that they cannot be set simultaneously, so that the multiple setting values in the job content can be set simultaneously.

The job content generation device according to one aspect of the present invention may generate the content using a machine learning model based on the voice data.

With this configuration, the job content generation device according to one aspect of the present invention corrects at least one of the multiple setting values in the job content when the multiple setting values in the job content are a combination that cannot be set simultaneously, so that the multiple setting values in the job content can be set simultaneously. Therefore, even if the job content is generated erroneously in the process of generating the job content using a machine learning model based on the voice data, the job content can be corrected.

In one aspect of the present invention, the job content generation device may correct at least one of the multiple setting values in the content based on the state of the image forming device, when the multiple setting values in the content are a combination that cannot be set simultaneously, so that the multiple setting values in the content are a combination that can be set simultaneously.

With this configuration, the job content generation device according to one aspect of the present invention corrects at least one of the multiple setting values in the job content based on the state of the image forming device, thereby improving the appropriateness of the corrected job content.

The job content generation device according to one aspect of the present invention may make the correction using the information transmitted from the image forming device by requesting the image forming device to transmit information indicating the status of the image forming device, and may determine that the combination is a predetermined combination that cannot be set, and if the combination can be corrected to the appropriate combination even without the information, may not make the request to the image forming device, may not obtain the information from the image forming device, and may make the correction without using the information.

With this configuration, the job content generation device according to one aspect of the present invention can omit the process of obtaining information indicating the state of the image forming device from the image forming device, even though the information is not necessary for correcting the job content.

In one aspect of the present invention, when the multiple setting values in the content include a copy job setting value as the setting value indicating that the job type is copy, and a setting value indicating that the source of the file used for the job is an external storage device attached to the image forming device, the job content generating device may correct the copy job setting value to the setting value indicating that the job type is print when the external storage device is actually attached to the image forming device.

With this configuration, in a job content generation device according to one aspect of the present invention, when multiple setting values in the job content include a copy job setting value as a setting value indicating that the job type is copy, and a setting value indicating that the source from which the file used for the job is read is an external storage device attached to the image forming device, if an external storage device is actually attached to the image forming device, the job content generation device corrects the copy job setting value to a setting value indicating that the job type is print, thereby improving the appropriateness of the job content after correction.

In one aspect of the present invention, when the multiple setting values in the content include a setting value indicating that the job type is a copy, an original size setting value as the setting value indicating the size of the original used for the job, and a paper size setting value as the setting value indicating the size of the paper on which an image is printed in the job, if the size of the original actually set in the image forming device is not the size indicated by the original size setting value but the size indicated by the paper size setting value, the job content generating device may make a correction to swap the size indicated by the original size setting value with the size indicated by the paper size setting value.

With this configuration, the job content generation device according to one aspect of the present invention, when multiple setting values in the job content include a setting value indicating that the job type is copy, a document size setting value indicating the size of the document used for the job, and a paper size setting value indicating the size of the paper on which the image is printed in the job, makes a correction to swap the size indicated in the document size setting value with the size indicated in the paper size setting value when the size of the document actually set in the image forming device is not the size indicated in the document size setting value but the size indicated in the paper size setting value, thereby improving the appropriateness of the job content after correction.

In one aspect of the present invention, when the multiple setting values in the content include a copy job setting value as the setting value indicating that the job type is copy, and a setting value indicating the file name of a file to be used for the job, the job content generating device may correct the copy job setting value to the setting value indicating that the job type is print.

With this configuration, when multiple setting values in the job content include a copy job setting value indicating that the job type is copy and a setting value indicating the file name of the file to be used for the job, the job content generation device according to one aspect of the present invention automatically corrects the copy job setting value to a setting value indicating that the job type is print, thereby improving convenience.

In one aspect of the present invention, when the multiple setting values in the content include a setting value indicating that the job type is document transmission, a transmission method setting value indicating the type of method for transmitting the document, and a transmission encryption setting value indicating the type of encryption used when transmitting the document, if the encryption type indicated in the transmission encryption setting value does not correspond to the transmission method type indicated in the transmission method setting value, the job content generation device may correct the encryption type indicated in the transmission encryption setting value to one that corresponds to the transmission method type indicated in the transmission method setting value.

With this configuration, the job content generation device according to one aspect of the present invention, when multiple setting values in the job content include a setting value indicating that the job type is document transmission, a transmission method setting value as a setting value indicating the type of document transmission method, and a transmission encryption setting value as a setting value indicating the type of encryption when the document is transmitted, if the encryption type indicated in the transmission encryption setting value does not correspond to the transmission method type indicated in the transmission method setting value, the encryption type indicated in the transmission encryption setting value is automatically corrected to one that corresponds to the transmission method type indicated in the transmission method setting value, thereby improving convenience.

A job content generation program according to one aspect of the present invention causes a computer to function as a job content generation unit that generates job content to be executed by an image forming device based on voice data indicating voice received by a voice receiving device that receives voice, and when multiple setting values in the content are in a predetermined combination that cannot be set simultaneously, the job content generation unit corrects at least one of the multiple setting values in the content to a setting value that is in a predetermined combination that can be set simultaneously.

With this configuration, when a combination of multiple setting values in the job content cannot be set simultaneously, the computer executing the job content generation program according to one aspect of the present invention corrects at least one of the multiple setting values in the job content so that the combination of multiple setting values in the job content can be set simultaneously, thereby improving convenience.

The job content generation device and job content generation program of the present invention can improve convenience.

1 is a block diagram of a voice operation system according to an embodiment of the present invention. 2 is a block diagram of the job content generation device shown in FIG. 1 when the job content generation device is configured by one computer. 3 is a diagram showing an example of inappropriate job content determination information shown in FIG. 2 . 2 is a block diagram of the job command generating device shown in FIG. 1 in the case where the job command generating device is configured by one computer. FIG. FIG. 2 is a block diagram of the image forming apparatus shown in FIG. 1 when it is an MFP. 2 is a sequence diagram of the operation of the voice operation system shown in FIG. 1 when the image forming apparatus is operated via a smart speaker. FIG. 7 is a sequence diagram of the "job content determination" shown in FIG. 6. FIG. 8 is a sequence diagram of the "job execution" shown in FIG. 7.

The following describes an embodiment of the present invention with reference to the drawings.

First, we will explain the configuration of a voice operation system according to one embodiment of the present invention.

FIG. 1 is a block diagram of a voice operation system 10 according to this embodiment.

As shown in FIG. 1, the voice operation system 10 includes a job content generation device 30 and a job command generation device 40. A smart speaker 20 is connected to the voice operation system 10 as a voice reception device that receives voice input from a user. The voice operation system 10 may include at least one other smart speaker having a similar configuration to the smart speaker 20 in addition to the smart speaker 20.

The job content generation device 30 generates the content of the job to be executed by the image forming device described below (hereinafter referred to as "job content") based on the voice data indicating the voice received by the smart speaker. The job content generation device 30 may be configured with one computer or multiple computers.

The job instruction generating device 40 generates job instructions (hereinafter referred to as "job instructions") that can be interpreted by the image forming device described below, based on the job content generated by the job content generating device 30. The job instruction generating device 40 may be configured with one computer or multiple computers. The voice operation system 10 may include at least one job instruction generating device having a similar configuration to the job instruction generating device 40 other than the job instruction generating device 40.

An image forming device 50, such as a dedicated printer or an MFP (Multifunction Peripheral), is connected to the voice operation system 10. At least one other image forming device having a similar configuration to the image forming device 50 may be connected to the voice operation system 10 in addition to the image forming device 50.

The smart speaker 20 can communicate with the job content generation device 30 via a network 11, such as the Internet.

In the voice operation system 10, the job content generation device 30 communicates with the job command generation device 40 via a network 11, such as the Internet.

The image forming device 50 can communicate with any of the job instruction generating devices within the same network, such as a LAN (Local Area Network). For example, the image forming device 50 can communicate with the job instruction generating device 40 within the same network 12. That is, the job instruction generating device 40 is located within the network 12. On the other hand, the job content generating device 30 is connected to the job instruction generating device 40 via a network 11, such as the Internet, which is different from the network 12, as described above, and is therefore located outside the network 12.

FIG. 2 is a block diagram of the job content generation device 30 when the job content generation device 30 is configured by a single computer.

As shown in FIG. 2, the job content generation device 30 includes an operation unit 31, which is an operation device such as a keyboard or mouse through which various operations are input; a display unit 32, which is a display device such as an LCD (Liquid Crystal Display) that displays various information; a communication unit 33, which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly by wire or wirelessly without using a network; a storage unit 34, which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) that stores various information; and a control unit 35 that controls the entire job content generation device 30.

The storage unit 34 stores a job content generation program 34a for generating job content based on voice data. The job content generation program 34a may be installed in the job content generation device 30 during the manufacturing stage of the job content generation device 30, or may be additionally installed in the job content generation device 30 from an external storage medium such as a USB (Universal Serial Bus) memory, or may be additionally installed in the job content generation device 30 from a network.

The storage unit 34 stores a text data conversion model 34b, which is a machine learning model for converting voice data into text data, and a job content conversion model 34c, which is a machine learning model for converting text data into job content.

The memory unit 34 stores inappropriate job content determination information 34d as information for determining inappropriate job content.

FIG. 3 shows an example of inappropriate job content determination information 34d.

As shown in FIG. 3, the inappropriate job content determination information 34d indicates, for each inappropriate combination, predetermined combinations of multiple setting values that cannot be set simultaneously in the job content (hereinafter referred to as "inappropriate combinations"), a priority order for determining which inappropriate combination it corresponds to, and a method for correcting the inappropriate combination. The combination of setting values indicated by the method for correcting the inappropriate combination is an example of a predetermined combination that can be set simultaneously in the job content.

For example, the inappropriate job content determination information 34d shown in FIG. 3 includes an inappropriate combination (hereinafter referred to as "inappropriate combination A") in which multiple setting values in the job content include a setting value indicating that the job type is copy (hereinafter referred to as "copy job setting value") and a setting value indicating that the source of the file used in the job is a USB memory as an external storage device attached to the image forming device (hereinafter referred to as "read source setting value"). In the inappropriate job content determination information 34d shown in FIG. 3, the copy job setting value is represented as "job type: copy". In the inappropriate job content determination information 34d shown in FIG. 3, the read source setting value is represented as "read source: USB memory".

In addition, for example, the inappropriate job content determination information 34d shown in FIG. 3 includes multiple setting values in the job content, including a copy job setting value, a setting value indicating the size of the document used in the job (hereinafter referred to as the "document size setting value"), and a setting value indicating the size of the paper on which the image is printed in the job (hereinafter referred to as the "paper size setting value"), and includes an inappropriate combination (hereinafter referred to as the "inappropriate combination B") in which the size of the document actually set in the image forming device is not the size indicated by the document size setting value.

Furthermore, for example, the inappropriate job content determination information 34d shown in FIG. 3 includes an inappropriate combination (hereinafter referred to as "inappropriate combination C") in which multiple setting values in the job content include a copy job setting value and a setting value indicating the file name of a file used in the job (hereinafter referred to as "file name setting value").

Furthermore, for example, in the inappropriate job content determination information 34d shown in FIG. 3, the multiple setting values in the job content include a setting value indicating that the job type is document transmission (hereinafter referred to as the "transmission job setting value"), a setting value indicating the type of document transmission method (hereinafter referred to as the "transmission method setting value"), and a setting value indicating the type of encryption when the document is transmitted (hereinafter referred to as the "transmission encryption setting value"), and includes an inappropriate combination (hereinafter referred to as the "inappropriate combination D") in which the encryption type indicated in the transmission encryption setting value does not correspond to the type of transmission method indicated in the transmission method setting value. In the inappropriate job content determination information 34d shown in FIG. 3, the transmission job setting value is represented as "job type: transmission".

With regard to priority, for example, the priority of inappropriate combination C is lower than the priority of inappropriate combination A and inappropriate combination B, so only if the combination does not fall under either inappropriate combination A or inappropriate combination B, is it determined whether or not the combination falls under inappropriate combination C.

In the inappropriate job content determination information 34d shown in FIG. 3, the correction method for inappropriate combination A is to correct the copy job setting value to a setting value where the job type is printing (hereinafter referred to as the "print job setting value") when a USB memory is actually attached to the image forming device. In the inappropriate job content determination information 34d shown in FIG. 3, the print job setting value is expressed as "job type: print".

In the inappropriate job content judgment information 34d shown in FIG. 3, the correction method for inappropriate combination B is a method of correcting by swapping the size indicated in the document size setting value and the size indicated in the paper size setting value when the size of the document actually set in the image forming device is the size indicated in the paper size setting value.

In the inappropriate job content determination information 34d shown in FIG. 3, the correction method for inappropriate combination C is to correct the copy job setting value to the print job setting value.

In the inappropriate job content determination information 34d shown in FIG. 3, the correction method for inappropriate combination D is to correct the encryption type indicated in the transmission encryption setting value to one that corresponds to the type of transmission method indicated in the transmission method setting value.

The control unit 35 shown in FIG. 2 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) that serves as a memory used as a working area for the CPU of the control unit 35. The CPU of the control unit 35 executes programs stored in the memory unit 34 or the ROM of the control unit 35.

The control unit 35 executes the job content generation program 34a to function as a job content generation unit 35a that generates job content based on the voice data.

FIG. 4 is a block diagram of the job command generating device 40 when the job command generating device 40 is configured by a single computer.

As shown in FIG. 4, the job command generating device 40 includes an operation unit 41, which is an operating device such as a keyboard or mouse through which various operations are input; a display unit 42, which is a display device such as an LCD that displays various information; a communication unit 43, which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly by wire or wirelessly without using a network; a storage unit 44, which is a non-volatile storage device such as a semiconductor memory or HDD that stores various information; and a control unit 45 that controls the entire job command generating device 40.

The storage unit 44 stores a job instruction generation program 44a for generating job instructions based on the job contents. The job instruction generation program 44a may be installed in the job instruction generating device 40 during the manufacturing stage of the job instruction generating device 40, or may be additionally installed in the job instruction generating device 40 from an external storage medium such as a USB memory, or may be additionally installed in the job instruction generating device 40 from a network.

The control unit 45 includes, for example, a CPU, a ROM that stores programs and various data, and a RAM as memory used as a working area for the CPU of the control unit 45. The CPU of the control unit 45 executes programs stored in the memory unit 44 or the ROM of the control unit 45.

The control unit 45 functions as a job command generating unit 45a that generates job commands based on the job contents by executing the job command generating program 44a.

When multiple setting values in the contents of a job to be executed by the image forming device 50 are a predetermined combination that cannot be set simultaneously, the job command generating unit 45a performs a process of correcting at least one of the multiple setting values in the contents to a setting value that is part of the predetermined combination that can be set simultaneously.

FIG. 5 is a block diagram of the image forming device 50 when the image forming device 50 is an MFP.

As shown in FIG. 5, the image forming apparatus 50 includes an operation unit 51, which is an operating device such as buttons through which various operations are input, a display unit 52, which is a display device such as an LCD that displays various information, a printer 53, which is a printing device that prints images on a recording medium such as paper, a scanner 54, which is a reading device that reads images from an original, a USB port 55, a communication unit 56, which is a communication device that communicates with an external device via a network such as a LAN or the Internet, or directly by wire or wirelessly without using a network, a fax communication unit 57, which is a fax device that communicates by fax with an external facsimile machine (not shown) via a communication line such as a public telephone line, a memory unit 58, which is a non-volatile memory device such as a semiconductor memory or HDD that stores various information, and a control unit 59 that controls the entire image forming apparatus 50.

The storage unit 58 stores a job execution program 58a for executing a job. The job execution program 58a may be installed in the image forming device 50 during the manufacturing stage of the image forming device 50, or may be additionally installed in the image forming device 50 from an external storage medium such as a USB memory, or may be additionally installed in the image forming device 50 from a network.

The control unit 59 includes, for example, a CPU, a ROM that stores programs and various data, and a RAM as memory used as a working area for the CPU of the control unit 59. The CPU of the control unit 59 executes programs stored in the memory unit 58 or the ROM of the control unit 59.

The control unit 59 functions as a job execution unit 59a that executes jobs by executing the job execution program 58a.

Next, we will explain the operation of the voice operation system 10 when the image forming device is operated via a smart speaker.

In the following, the smart speaker that accepts voice operations for operating the image forming device will be described as smart speaker 20. In addition, the image forming device that is the target of the voice operations accepted by smart speaker 20 will be described as image forming device 50.

FIG. 6 is a sequence diagram of the operation of the voice operation system 10 when the image forming device 50 is operated via the smart speaker 20. FIG. 7 is a sequence diagram of the "job content determination" shown in FIG. 6. FIG. 8 is a sequence diagram of the "job execution" shown in FIG. 7.

The user inputs voice into the smart speaker 20 indicating the operation to be performed on the image forming device 50.

When voice is input, the smart speaker 20 accepts the voice input to the smart speaker 20 itself (S61), as shown in Figures 6 to 8.

When the processing of S61 is completed, the smart speaker 20 transmits voice data indicating the voice received in S61 to the job content generation device 30 (S62).

For example, if the user inputs the voice command "copy on both sides" into the smart speaker 20, the smart speaker 20 transmits voice data indicating the voice command "copy on both sides" to the job content generation device 30 (S62).

When voice data is transmitted from the smart speaker 20 in S62, the job content generation unit 35a of the job content generation device 30 converts the voice data transmitted from the smart speaker 20 in S62 into text data using the text data conversion model 34b (S63).

When the process of S63 is completed, the job content generation unit 35a converts the text data generated in S63 into job content using the job content conversion model 34c (S64).

For example, when voice data indicating the voice saying "Copy on both sides" is transmitted from the smart speaker 20 to the job content generating device 30, the job content generating unit 35a of the job content generating device 30 converts the voice data indicating the voice saying "Copy on both sides" into job content including the contents "job type: copy" and "print side: double-sided" (S63 to S64). Here, "print side: double-sided" is a setting value for printing on both sides of the paper on which the image is printed in the job. That is, the job content generating unit 35a converts predetermined keywords (for example, the keywords "copy", "print", and "send" for the setting item "job type", "print side", "read source", "original size", "file name", "send method", "encryption method", "destination", etc.) as setting values related to each setting item constituting the job (for example, the keywords "copy", "print", and "send" for the setting item "job type", "double-sided" and "single-sided" for the setting item "print side", "USB memory" and "user hooks" for the setting item "read source", and "A4", "A3", "B4", etc. for the setting item "original size"). For the setting item "File name", "File A", "File B", etc. For the setting item "Transmission method", "FTP transmission", etc. For the setting item "Encryption method", "FTP encryption", "Email encryption", etc. For the setting item "Destination", "Taro", "Jiro", etc.) is stored, and it is determined whether the voice data contains the keyword, and if the keyword is included, it further determines the setting item corresponding to the word indicated by the keyword, thereby converting the voice data into components that make up the job content, such as "Job type: Copy" or "Print side: Double-sided".

For example, when voice data indicating a voice saying "Print the file in the USB memory" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating a voice saying "Print the file in the USB memory" into job content including the contents "job type: print" and "source: USB memory" (S63-S64). However, there is also a possibility that the job content generation unit 35a erroneously converts the voice data into job content including the contents "job type: copy" and "source: USB memory" (S63-S64).

Also, for example, when voice data indicating a voice saying "Copy from A4 to A3" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating the voice saying "Copy from A4 to A3" into job content including the contents "job type: copy", "original size: A4" and "paper size: A3" (S63 to S64). However, the job content generation unit 35a may erroneously convert into job content including the contents "job type: copy", "original size: A3" and "paper size: A4" (S63 to S64). Here, "original size: A3" is an original size setting value indicating that the size of the original set in the image forming device is A3 size. "Original size: A4" is an original size setting value indicating that the size of the original set in the image forming device is A4 size. "Paper size: A3" is a paper size setting value indicating that the size of the paper on which the image is printed in the job is A3 size. "Paper size: A4" is a paper size setting value that indicates that the size of the paper on which the image is printed in the job is A4 size.

For example, when voice data indicating the voice saying "Copy file A" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating the voice saying "Copy file A" into job content including the contents "job type: copy" and "file name: file A". Here, "file name: file A" is a file name setting value indicating that the file name of the file used for the job is "file A".

Also, for example, when voice data indicating a voice saying "Encrypt the image and send the document to Taro by FTP" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating a voice saying "Encrypt the image and send the document to Taro by FTP" into job content including the contents of "job type: send", "send method: FTP send", "encryption method: FTP encryption", and "destination: Taro" (S64). However, the job content generation unit 35a may erroneously convert the voice data into job content including the contents of "job type: send", "send method: FTP send", "encryption method: e-mail encryption", and "destination: Taro" (S64). Here, "destination: Taro" is a setting value indicating "Taro" as the destination of the document transmission. "Send method: FTP send" is a transmission method setting value indicating FTP transmission as the type of document transmission method. "Encryption method: FTP encryption" is a transmission encryption setting value that indicates "FTP encryption" as the type of encryption used when sending a document. "Encryption method: Email encryption" is a transmission encryption setting value that indicates "Email encryption" as the type of encryption used when sending a document.

When the process of S64 is completed, the job content generation unit 35a requests the job command generation device 40 to send information indicating the status of the image forming device 50 (S65).

When the job content generating device 30 requests the job command generating unit 45a of the job command generating device 40 to transmit information indicating the status of the image forming device 50 in S65, the job command generating unit 45a requests the image forming device 50 to transmit information indicating the status of the image forming device 50 (S66).

When the job execution unit 59a of the image forming device 50 is requested by the job command generating device 40 to transmit information indicating the status of the image forming device 50 in S66, the job execution unit 59a transmits information indicating the status of the image forming device 50 to the job command generating device 40 (S67). For example, the job execution unit 59a transmits to the job command generating device 40 as information indicating the status of the image forming device 50, information indicating whether a USB memory is attached to the USB port 55, information indicating whether a document is set in the scanner 54, and, if a document is set in the scanner 54, information indicating the size of the document set in the scanner 54, as the status of the image forming device 50 (S67).

For example, when the control unit 59 of the image forming device 50 can communicate with the USB memory via the USB port 55, the control unit 59 determines that a USB memory is attached to the USB port 55. The control unit 59 also determines whether or not a document is set on the scanner 54 based on a document detection signal received from a sensor that detects whether a document is placed on a document reading table (e.g., a flatbed or a document placement table of an automatic document feeder) provided in the scanner 54. Alternatively, the control unit 59 stores size information received by an operation unit (provided in the image forming device 50) to which size information indicating the size of the recording paper contained in the paper feed cassette is input, and detects the size of the recording paper contained in the paper feed cassette to be used for printing based on the stored size information.

When information indicating the status of the image forming device 50 is sent from the image forming device 50 in S67, the job command generating unit 45a of the job command generating device 40 sends the information indicating the status of the image forming device 50 sent from the image forming device 50 in S67 to the job content generating device 30 (S68).

When the job content generation unit 35a of the job content generation device 30 receives the information indicating the status of the image forming device 50 sent from the job command generation device 40 in S68, it determines whether the job content generated in S64 is inappropriate based on the job content generated in S64, the received information indicating the status of the image forming device 50, and the inappropriate job content determination information 34d (S69).

For example, if the job content generation unit 35a generates job content including the content "job type: copy" and "source: USB memory" in S64, the job content generated in S64 corresponds to the above-mentioned inappropriate combination A, and therefore determines in S69 that the job content generated in S64 is inappropriate.

In addition, for example, if the job content generating unit 35a generates job content including the content "job type: copy", "original size: A3" and "paper size: A4" in S64, when "A4" is sent from the job command generating device 40 in S68 as the size of the original set in the image forming device 50, the job content generated in S64 corresponds to the above-mentioned inappropriate combination B, and therefore the job content generated in S64 is determined to be inappropriate in S69.

In addition, for example, when the job content generation unit 35a generates job content including the content "job type: copy" and "file name: file A" in S64, the job content generated in S64 corresponds to the above-mentioned inappropriate combination C, and therefore the job content generated in S64 is determined to be inappropriate in S69.

For example, if the job content generation unit 35a generates job content in S64 that includes the content "job type: send," "send method: FTP send," "encryption method: e-mail encryption," and "destination: Taro," the job content generated in S64 falls under the inappropriate combination D described above, and therefore the job content generated in S64 is determined to be inappropriate in S69.

If the job content generation unit 35a determines in S69 that the job content generated in S64 is inappropriate, it determines whether the job content generated in S64 can be corrected (S70) based on the job content generated in S64, the information indicating the state of the image forming device 50 received from the job command generation device 40 (S68), and the inappropriate job content determination information 34d.

For example, when the job content generating unit 35a generates job content including the content "job type: copy" and "source: USB memory" in S64, and information indicating that a USB memory is not attached to the image forming device 50 is sent from the job command generating device 40 in S68, and when this information is received, the job content generating unit 35a determines in S70 that the job content generated in S64 cannot be corrected based on the inappropriate job content determination information 34d.

If, in S70, the job content generation unit 35a determines that the job content generated in S64 cannot be corrected, the job content generation unit 35a notifies the smart speaker 20 of an error (S71).

When the smart speaker 20 is notified of an error by the job content generation device 30 in S71, it outputs the error notified by the job content generation device 30 in S71 by voice (S72).

In addition, when the job content generation unit 35a determines in S70 that the job content generated in S64 can be corrected, it corrects the job content generated in S64 based on the job content generated in S64, the information indicating the state of the image forming device 50 transmitted in S68 from the job command generation device 40, and the inappropriate job content determination information 34d (S73).

For example, if the job content generating unit 35a generates job content including the contents "job type: copy" and "source: USB memory" in S64, when the job command generating device 40 transmits in S68 that a USB memory is attached to the image forming device 50, the job content generating unit 35a corrects the job content including the contents "job type: copy" and "source: USB memory" generated in S64 to the job content including the contents "job type: print" and "source: USB memory" based on the "correction method" of the inappropriate job content determination information 34d.

For example, when the job content generating unit 35a generates job content including "job type: copy", "original size: A3" and "paper size: A4" in S64 and "A4" is transmitted from the job command generating unit 40 in S68 as the size of the original set in the image forming device 50, the job content generating unit 35a corrects the job content including "job type: copy", "original size: A3" and "paper size: A4" generated in S64 to job content including "job type: copy", "original size: A4" and "paper size: A3" based on the "correction method" in the inappropriate job content determination information 34d.

In addition, for example, when the job content generation unit 35a generates job content including the content "job type: copy" and "file name: file A" in S64, the job content generation unit 35a corrects the job content including the content "job type: copy" and "file name: file A" generated in S64 to the job content including the content "job type: print" and "file name: file A" based on the "correction method" of the inappropriate job content determination information 34d.

In addition, for example, when the job content generation unit 35a generates job content including the contents "job type: sending", "sending method: FTP sending", "encryption method: email encryption" and "destination: Taro" in S64, the job content generation unit 35a corrects the job content generated in S64 including the contents "job type: sending", "sending method: FTP sending", "encryption method: email encryption" and "destination: Taro" to the job content including the contents "job type: sending", "sending method: FTP sending", "encryption method: FTP encryption" and "destination: Taro" based on the "correction method" of the inappropriate job content determination information 34d.

If the job content generation unit 35a determines in S69 that the job content generated in S64 is not inappropriate, or if the processing of S73 is completed, the job content determined in S69 to be not inappropriate or the job content corrected in S73 is sent to the job command generation device 40 (S74).

The transmission method in S74 may be any method that can transmit job content from the job content generation device 30 to the job instruction generation device 40. For example, if a publish-subscribe model messaging service is used as the transmission method in S74, the job content generation unit 35a can transmit the job content by publishing a message including the job content. Also, if a publish-subscribe model messaging service is used as the transmission method in S74, the job instruction generation unit 45a of the job instruction generation device 40 can receive the job content by subscribing to the published message.

When the job content is sent from the job content generating device 30 in S74, the job command generating unit 45a of the job command generating device 40 converts the job content sent from the job content generating device 30 in S74 into a job command that can be interpreted by the image forming device 50, i.e., into a job command in a format that can be accepted by the interface provided in the image forming device 50 (S75).

When the processing of S75 is completed, the job command generating unit 45a transmits the job command generated in S75 to the image forming device 50 (S76).

The transmission method in S76 may be any method that can transmit a job command from the job command generating device 40 to the image forming device 50. For example, if a Web service format interface provided in the image forming device 50 is used as the transmission method in S76, the job command generating unit 45a transmits the job command by calling this Web service. Also, if a Web service format interface provided in the image forming device 50 is used as the transmission method in S76, the job executing unit 59a of the image forming device 50 receives the job command transmitted by calling this Web service.

When the job command is sent from the job command generating device 40 in S76, the job executing unit 59a of the image forming device 50 executes the job according to the job command sent from the job command generating device 40 in S76 (S77).

As described above, when the job content has a combination of multiple setting values that cannot be set simultaneously, the job content generation device 30 corrects at least one of the multiple setting values in the job content so that the multiple setting values in the job content can be set simultaneously (S73), thereby improving convenience. For example, when the job content has a combination of multiple setting values that cannot be set simultaneously, the job content generation device 30 corrects the copy job setting value to a print job setting value, thereby improving convenience. Also, when the job content has a combination of multiple setting values that cannot be set simultaneously, for example, the job content generation device 30 corrects the copy job setting value to a print job setting value when the job content has a combination of multiple setting values that cannot be set simultaneously, the job content generation device 30 corrects the encryption type indicated in the encryption setting value to one that corresponds to the transmission method type indicated in the transmission method setting value when the job content has a transmission job setting value, a transmission method setting value, and a transmission encryption setting value, thereby improving convenience.

In particular, the job content generating device 30 corrects at least one of the multiple setting values in the job content based on the state of the image forming device 50, thereby improving the appropriateness of the job content after correction. For example, when the multiple setting values in the job content include a copy job setting value and a read source setting value, the job content generating device 30 corrects the copy job setting value to a print job setting value when a USB memory is actually attached to the image forming device 50, thereby improving the appropriateness of the job content after correction. Also, for example, when the multiple setting values in the job content include a copy job setting value, an original size setting value, and a paper size setting value, when the size of the original actually set in the image forming device is not the size indicated by the original size setting value but the size indicated by the paper size setting value, the job content generating device 30 performs a correction to swap the size indicated by the original size setting value with the size indicated by the paper size setting value, thereby improving the appropriateness of the job content after correction.

When the job content has a combination of multiple setting values that cannot be set simultaneously, the job content generation device 30 corrects at least one of the multiple setting values in the job content so that the combination of multiple setting values in the job content can be set simultaneously. Therefore, even if the job content is generated erroneously in the process of generating the job content using a machine learning model based on the voice data, the job content can be automatically corrected.

The voice operation system 10 requires that the job content generation device 30, which needs to have high processing power in order to generate job content based on voice data indicating voice received by the smart speaker 20, is not located within the same network 12 as the image forming device 50, and the job instruction generation device 40, which generates job instructions that can be interpreted by the image forming device 50 based on the job content generated by the job content generation device 30, is located within the same network 12 as the image forming device 50. This makes it possible to reduce the processing power required for the computer that constitutes the job instruction generation device 40 located within the same network 12 as the image forming device 50.

The voice operation system 10 includes a job command generating device 40 that generates job commands that can be interpreted by the image forming device 50 and is located inside the same network 12 as the image forming device 50. Therefore, even if the image forming device 50 does not have a mechanism for receiving job commands that can be interpreted by the image forming device 50 from outside the network 12, the image forming device 50 can be operated via the smart speaker 20.

The voice operation system 10 requires high processing power to convert voice data representing voice received by the smart speaker 20 into job content using machine learning models called text data conversion model 34b and job content conversion model 34c. However, the job content generation device 30 is not located within the same network 12 as the image forming device 50. This reduces the processing power required for a computer located within the same network 12 as the image forming device 50.

In this embodiment, the job content generation device 30 converts the voice data transmitted from the smart speaker 20 into text data and then converts it into job content. However, the job content generation device 30 may also convert the voice data transmitted from the smart speaker 20 into job content directly using a machine learning model without converting it into text data.

In this embodiment, the job content generation device 30 acquires the status of the image forming device 50 after the process of S64. However, after the process of S64, the job content generation device 30 determines that the job content generated in S64 corresponds to an inappropriate combination based on the inappropriate job content judgment information 34d, and if the combination can be corrected to an appropriate combination based on the inappropriate job content judgment information 34d, the job content generation device 30 may not request the image forming device 50 to transmit information indicating the status of the image forming device 50. In this case, the processes of S65 to S69 are not performed, and after the above judgment, the job content generation device 30 performs the process of S70 based on the information indicated by the inappropriate job content judgment information 34d. This omits the request to transmit information indicating the status of the image forming device 50 that is not necessary for correcting the job content and the reception of the information. Note that the job content generation device 30 requests the image forming device 50 to transmit information indicating the status of the image forming device 50 only when the correction to the appropriate combination cannot be made based on the information indicated by the inappropriate job content judgment information 34d.

In this embodiment, the voice operation system 10 includes a job command generating device 40 in addition to the job content generating device 30. However, the job content generating device 30 may also include the function of the job command generating device 40, which is to generate job commands that can be interpreted by the image forming device 50. If the job content generating device 30 includes the function of the job command generating device 40, it may be disposed inside the network 12.

In this embodiment, the voice operation system 10 employs a USB memory as the external storage device attached to the image forming device. However, the external storage device attached to the image forming device may be a storage device other than a USB memory.

Claims (9)

A job content generation device that generates job content to be executed by an image forming device based on voice data indicating a voice received by a voice receiving device,
The job content generation device includes:
A job content generation device including a processor, and a control unit that functions as a job content generation unit that, when multiple setting values in the content are a predetermined combination that cannot be set simultaneously, corrects at least one of the multiple setting values in the content to a setting value that is one of the predetermined combinations that can be set simultaneously by executing a job content generation program by the processor. The job content generation device according to claim 1, which generates the content using a machine learning model based on the voice data. The job content generating device according to claim 1, wherein, when the multiple setting values in the content are in the predetermined combination that cannot be set, the job content generating unit corrects at least one of the multiple setting values in the content to a setting value that is in the predetermined combination that can be set simultaneously based on the state of the image forming device. The job content generation unit
requesting the image forming apparatus to transmit information indicating a state of the image forming apparatus, and making the correction using the information transmitted from the image forming apparatus;
4. The job content generation device according to claim 3, wherein if it determines that the combination is a predetermined combination that cannot be set and that the combination can be corrected to the appropriate combination even without the information, the device does not make the request to the image forming device, does not obtain the information from the image forming device, and performs the correction without using the information. The job content generation unit
When the plurality of setting values in the content are the predetermined combination that cannot be set, the combination includes a copy job setting value as the setting value that the type of the job is a copy, and the setting value that the source of the file used in the job is an external storage device attached to the image forming apparatus,
A job content generation device as described in claim 3, wherein when the external storage device is actually attached to the image forming device, the copy job setting value is corrected to the setting value in which the job type is printing, thereby correcting multiple setting values in the content to setting values that form a predetermined combination that can be set simultaneously. The job content generation unit
When the plurality of setting values in the content are the predetermined combination that cannot be set, including the setting value that the type of the job is copy, an original size setting value as the setting value indicating the size of the original used in the job, and a paper size setting value as the setting value indicating the size of the paper on which an image is printed in the job,
A job content generation device as described in claim 3, wherein when the size of the original actually set in the image forming device is not the size indicated in the original size setting value but the size indicated in the paper size setting value, a correction is made to swap the size indicated in the original size setting value with the size indicated in the paper size setting value, thereby correcting multiple setting values in the content to setting values that form a predetermined combination that can be set simultaneously. The job content generation unit
When the plurality of setting values in the content are the predetermined combination that cannot be set, including a copy job setting value as the setting value that the type of the job is copy, and a setting value that indicates a file name of a file to be used for the job,
A job content generation device as described in claim 1, wherein by correcting the copy job setting value to the setting value in which the job type is printing, multiple setting values in the content are corrected to setting values that are a predetermined combination that can be set simultaneously. The job content generation unit
When the plurality of setting values in the content are the predetermined combination that cannot be set, including the setting value that the type of the job is document transmission, a transmission method setting value as the setting value indicating the type of the method of transmitting the document, and a transmission encryption setting value as the setting value indicating the type of encryption when transmitting the document,
A job content generation device as described in claim 1, wherein when the type of encryption indicated in the encryption setting value at the time of transmission does not correspond to the type of transmission method indicated in the transmission method setting value, the type of encryption indicated in the encryption setting value at the time of transmission is corrected to one that corresponds to the type of transmission method indicated in the transmission method setting value, thereby correcting multiple setting values in the content to setting values that form a predetermined combination that can be set simultaneously. Computer,
a job content generating unit that generates job content to be executed by the image forming apparatus based on voice data indicating a voice received by a voice receiving device that receives voice;
The job content generation unit is a job content generation program that, when multiple setting values in the content are in a predetermined combination that cannot be set simultaneously, corrects at least one of the multiple setting values in the content to a setting value that is in a predetermined combination that can be set simultaneously.

Images