JP2014197360A - Mobile terminal and program - Google Patents

Abstract

Provided is a technique for improving operability when performing image processing by an image processing apparatus using a portable terminal. In a portable terminal capable of performing close proximity wireless communication with an image processing apparatus existing within a communication range, it is determined whether the attitude of the portable terminal is portrait or landscape (S108). Then, a transmission image to be transmitted to the image processing apparatus is determined according to the attitude of the mobile terminal when the image processing apparatus exists within the communication range of the close proximity wireless communication (S110, S114). That is, the transmission image is determined according to the attitude of the mobile terminal when the mobile terminal is brought close to the image processing apparatus. Thereby, it is possible to omit a user operation for selecting an image to be processed on the mobile terminal, and operability when performing image processing by the image processing apparatus using the mobile terminal is improved. [Selection] Figure 7

Description

  The present invention relates to a portable terminal that transmits image information to an image processing apparatus, and a program that can be read by a computer of the portable terminal.

  In recent years, proximity wireless communication systems such as NFC (abbreviation of Near Field Communication) have been proposed. With these proximity wireless communication technologies, wireless data communication is performed simply by bringing communication target devices close to each other.

  Specifically, as described in the following patent document, when data is transmitted and received between the communication device 1 and the communication device 2, the communication device 1 first starts near field communication, that is, NFC. The communication method and the encryption method are acquired from the communication device 2 by wireless data communication of the method. Then, when the acquired communication method and encryption method match the communication method and encryption method defined in the communication device 1, the communication method can transmit and receive data at a higher speed than NFC. It is disclosed to perform data communication with the device 2.

JP 2007-166538 A

  However, the technique described in the above patent document has the following problems. Specifically, even if a mobile terminal such as a smartphone or a tablet PC and an image processing apparatus are brought close to each other and close proximity wireless communication is established, user operations such as image processing instructions are performed for image processing after the wireless communication is established. Therefore, operability is low. The present invention has been made in view of such circumstances, and provides a technique for improving operability when performing image processing by an image processing apparatus using close proximity wireless communication.

  In order to solve the above problems, a program described as an embodiment of the present specification includes a proximity wireless communication unit that performs proximity wireless communication with an image processing device that exists within a communication range, and sensor information based on the attitude of a mobile terminal. A computer-readable program comprising: a sensor for outputting; and a storage unit for storing an image information set that can include a plurality of pieces of image information. Sensor information acquisition means for acquiring information, and transmission image information that is image information to be transmitted to the image processing device among the plurality of image information included in the image information set stored in the storage unit, Before the sensor information acquired by the sensor information acquisition means when the image processing apparatus exists within the communication range of the proximity wireless communication An image information determination means for determining based on the orientation of the mobile device, characterized in that to function with.

  In order to solve the above problem, the portable terminal described as an embodiment of the present specification is based on a proximity wireless communication unit that performs proximity wireless communication with an image processing device that exists within a communication range, and a posture of the portable terminal. A portable terminal comprising: a sensor that outputs sensor information; a storage unit that stores an image information set that can include a plurality of pieces of image information; and a processor, wherein the processor outputs sensor information output by the sensor. Sensor information acquisition means for acquiring image information, and transmission image information that is image information to be transmitted to the image processing device among the plurality of image information included in the image information set stored in the storage unit, Based on the attitude of the portable terminal indicated by the sensor information acquired by the sensor information acquisition means when the image processing apparatus exists within the communication range of close proximity wireless communication An image information determination means determining, characterized in that it functions by.

  In the portable terminal or the program described as the embodiment of the present specification, the image to be printed on the portable terminal is established after the proximity wireless communication is established only by bringing the portable terminal close to the image processing apparatus in a posture corresponding to the determination of the transmission image. Since the image processing by the image processing apparatus can be performed without the need for user operation for selecting information, the operability is good.

  In the portable terminal or the like described as the embodiment of the present specification, when the image processing apparatus is in the communication range of the proximity wireless communication with the portable terminal, the portable terminal is simply set in a posture corresponding to the determination of the transmission image. Since it is possible to perform image processing by the image processing apparatus without performing a user operation for selecting image information to be printed on the portable terminal, operability is good. In addition, even when the attitude of the mobile terminal changes when the image processing apparatus is in the communication range of the proximity wireless communication with the mobile terminal, it is possible to determine the transmission image corresponding to the attitude, so that the operability Is good.

  In the portable terminal or the like described as an embodiment of the present specification, when the image processing apparatus is in the communication range of the close proximity wireless communication with the portable terminal, the portable terminal corresponds to either all image processing or selected image processing. Since it is possible to easily select either all-image processing or selected image processing simply by making the posture to perform, the operability is good.

  In a portable terminal or the like described as an embodiment of the present specification, an image selected by a portable terminal can be easily obtained by setting the attitude of the portable terminal to a posture corresponding to processing for printing an image selected by the portable terminal. Since it can be processed by the image processing apparatus, operability is good.

  In the portable terminal or the like described as the embodiment of the present specification, unless the user satisfies the predetermined condition in consideration, the transmission image is not transmitted from the portable terminal to the image processing apparatus, and image processing is not performed. As a result, it is possible to suppress the occurrence of image processing that the user is not aware of, that is, erroneous image processing, so that operability is good.

  In the portable terminal described in the embodiment of the present specification, the above condition is not satisfied unless the user consciously brings the portable terminal close to the image processing apparatus a predetermined number of times. Therefore, operability is good.

  In the portable terminal or the like described in the embodiment of the present specification, the above condition is not satisfied unless the user keeps the portable terminal close to the image processing apparatus for a predetermined time. Since it becomes possible to suppress, operability is good.

  In the portable terminal described in the embodiment of the present specification, when a transmission image is determined and a predetermined condition is satisfied, the determined transmission image is determined even if the portable terminal is separated from the image processing apparatus. Since it is possible to output information on the image processing apparatus by long-distance wireless communication, operability is good.

  In the portable terminal described as an embodiment of the present specification, when the image processing apparatus exists within the communication range of close proximity wireless communication, the determined transmission image is displayed on the display unit in a recognizable state. Thus, the user can take immediate action such as confirming the selected image and changing the attitude of the mobile terminal, and thus the operability is good.

1 is a block diagram of a communication system 1. FIG. It is a figure which shows the display mode of the image 100 on the panel 22 of the mobile telephone 10. FIG. It is a figure which shows the display mode of the image 100 on the panel 22 of the mobile telephone 10 of a vertical orientation. It is a figure which shows the display mode of the image 100 on the panel 22 of the mobile telephone 10 of a horizontal orientation. FIG. 3 is a sequence diagram during printing processing in the communication system 1; FIG. 5 is a diagram showing an operation flowchart of the mobile phone 10. FIG. 5 is a diagram showing an operation flowchart of the mobile phone 10. FIG. 5 is a diagram showing an operation flowchart of the mobile phone 10. It is a sequence diagram at the time of the printing process in the communication system 1 of 2nd Embodiment. It is a sequence diagram at the time of the printing process in the communication system 1 of 3rd Embodiment. It is a figure which shows the display mode of the image 100 on the panel 22 of the mobile telephone 10 of the horizontal orientation in a modification.

<First Embodiment>
FIG. 1 shows a block diagram of a communication system 1 exemplified as the first embodiment according to the present application. The communication system 1 includes a mobile phone 10 and an MFP (abbreviation of Multifunction Peripheral) 50. The mobile phone 10 and the MFP 50 have a function as a known wireless LAN terminal device. The MFP 50 is a multifunction peripheral device having a printer function, a scanner function, a copy function, a facsimile function, and the like.

  The configuration of the mobile phone 10 will be described. The mobile phone 10 mainly includes a CPU (abbreviation of central processing unit) 12, a storage unit 14, a wireless LAN I / F 18, an NFC I / F 20, a panel 22, a button input unit 24, an inclination sensor 26, a speaker 28, and a microphone 30. Yes. These components can communicate with each other via the input / output port 31.

  The wireless LAN I / F 18 is capable of performing wireless communication 90 of the WiFi Direct (registered trademark) system (sometimes abbreviated as WFD system) based on the IEEE 802.11 standard and standards conforming thereto. Has been. That is, when the mobile phone 10 accesses the access point provided in the MFP 50 and becomes capable of performing WFD wireless communication 90, the mobile phone 10 can directly perform data communication with the MFP 50.

  The NFC I / F 20 can perform NFC wireless communication 92 based on the international standard of ISO / IEC 21481 or ISO / IEC 18092. In other words, the mobile phone 10 can directly perform data communication with the MFP 50 when the mobile phone 10 is ready to perform NFC wireless communication 92. However, the NFC wireless communication 92 has a shorter communication distance and a lower communication speed than the WFD wireless communication 90.

  Here, the definition of the words “data” and “information” will be described. In this specification, “data” and “information” use “information” as a superordinate concept of “data”. Therefore, “A data” may be rephrased as “A information”. In addition, “B data” copied or converted from “A data” is “A information” as long as it is used with the same meaning as “A data”.

  The CPU 12 executes processing according to the program 32 in the storage unit 14. Hereinafter, the CPU 12 that executes a program, such as the print application 32a, may be simply described as a program name. For example, the description “print application 32a” may mean “the CPU 12 executing the print application 32a”. The storage unit 14 is configured by combining a RAM (abbreviation of random access memory), a ROM (abbreviation of read only memory), a flash memory, an HDD (abbreviation of hard disk), a buffer provided in the CPU 12, and the like.

  The storage unit 14 stores a program 32. The program 32 includes a print application 32a and an operating system 32b (sometimes abbreviated as OS 32b). The print application 32a is an application for causing the CPU 12 to execute processing for causing the MFP 50 to print an image represented by the content data stored in the content data storage area 14a. The storage unit 14 may be a computer-readable storage medium. The computer-readable storage medium is a non-transitory medium such as a ROM, RAM, flash memory, or hard disk. Electric signals that carry programs downloaded from servers on the Internet are not included in non-transitory media.

  The operating system 32b is a program that provides basic functions used by the print application 32a. The OS 32b includes a program for executing wireless communication 90 and 92 via the wireless LAN I / F 18 and NFC I / F 20, and a program for controlling the storage unit 14, the panel 22, the button input unit 24, the tilt sensor 26, and the like. Including.

  The storage unit 14 includes a content data storage area 14a. The content data storage area 14a is an area for storing a plurality of photo data and document data. JPEG data is stored as photo data, and PDF data is stored as document data. Photo data is an example of image data. The document data is usually composed of a plurality of page document data corresponding to a plurality of pages. Page document data is an example of image data. The print application 32a acquires data stored in the storage unit 14 via the OS 32b.

  The panel 22 includes a display surface that displays various functions of the mobile phone 10. The print application 32a outputs image data for display and displays it on the panel 22 via the OS 32b. The button input unit 24 includes a touch sensor and is configured integrally with the panel 22. The button input unit 24 detects approach / contact of the input medium to the panel 22 and accepts a button operation by the user. The print application 32a acquires data indicating the button operation content by the user via the OS 32b. The tilt sensor 26 is a sensor that measures the tilt angle at which the mobile phone 10 is tilted with respect to the horizontal plane by detecting the angular velocity. The print application 32a acquires sensor data output from the tilt sensor 26 via the OS 32b.

<Browsing images on mobile phones>
In the mobile phone 10, an image based on the content data stored in the content data storage area 14a can be browsed. Specifically, the content data storage area 14a of the mobile phone 10 stores a plurality of JPEG format photo data and PDF format document data as content data. As shown in FIG. 2, an image 100 based on one or more pieces of image data constituting content data in a predetermined range is displayed on the panel 22 one by one. When displaying an image based on photo data, an image based on one or more photo data in a predetermined group is displayed. The photo data in the predetermined group may be photo data in one folder or photo data to which a predetermined tag is attached. When displaying an image based on document data, an image based on one or more page document data in the document data is displayed. Note that one or more image data selected in advance by the user from a plurality of image data may be displayed. On both sides of the image 100, a return button 102 and a feed button 104 are displayed. The return button 102 and the feed button 104 are buttons for sequentially switching the displayed images 100, and an arbitrary image 100 is displayed on the panel 22 by a tap operation on the return button 102 and the feed button 104. . By such an operation, the user can browse an arbitrary image 100 based on one or more image data included in the content data. That is, the image displayed on the panel 22 is an example of an image based on the image data selected on the mobile phone 10.

<Handover processing>
In the communication system 1, it is possible to print an arbitrary image 100 viewed with the mobile phone 10 using the MFP 50. Specifically, the mobile phone 10 can be brought close to the MFP 50 to establish the NFC wireless communication 92, and printing using the NFC wireless communication 92 (may be abbreviated as NFC printing) is possible. It is. Specifically, when the distance between the mobile phone 10 and the MFP 50 is within the communication range of the NFC wireless communication 92 due to the approach of the mobile phone 10 to the MFP 50, the initial NFC method is established between the mobile phone 10 and the MFP 50. Sequence processing is executed, and NFC wireless communication 92 is established. When the NFC wireless communication 92 is established, connection information for establishing the WFD wireless communication 90 is transmitted and received between the mobile phone 10 and the MFP 50 using the wireless communication 92.

  The WFD wireless communication 90 is established because the WFD wireless communication 90 can transmit and receive data at a higher speed than the NFC wireless communication 92. This is because it is preferable to use the WFD wireless communication 90. The WFD wireless communication 90 can transmit and receive data over a longer distance than the NFC wireless communication 92, and document data or photo data can be transmitted and received by the WFD wireless communication 90. preferable.

  The process of switching to the WFD wireless communication 90 that can transmit and receive data at a higher speed than the NFC method using the NFC wireless communication 92 is called a handover process. Hereinafter, execution of the handover process will be described.

  The connection information for establishing the WFD wireless communication 90 includes, for example, SSID (abbreviation of Service Set IDentifier), and the NSID wireless communication 92 is used between the mobile phone 10 and the MFP 50. Are transmitted and received. That is, when the NFC wireless communication 92 is established, first, the SSID used by the wireless LAN I / F 18 of the mobile phone 10 is transmitted from the mobile phone 10 to the MFP 50 by the NFC wireless communication 92.

  Then, the SSID for accessing the wireless LAN I / F 68 of the MFP 50 and establishing the WFD wireless communication 90 is transmitted from the MFP 50 to the mobile phone 10 by the NFC wireless communication 92. Then, the mobile phone 10 establishes WFD wireless communication 90 with the MFP 50 based on the SSID of the MFP 50.

<Print processing according to the attitude of the mobile phone>
When the WFD wireless communication 90 is established between the mobile phone 10 and the MFP 50, arbitrary image data among a plurality of image data included in the content data is transferred from the mobile phone 10 to the MFP 50 using the wireless communication 90. Then, the MFP 50 performs an image printing process based on the transmitted image data. At this time, image data transmitted from the mobile phone 10 to the MFP 50 is selected according to the attitude of the mobile phone 10. That is, the image to be printed is selected according to the attitude of the mobile phone 10.

  Specifically, based on the sensor data output from the tilt sensor 26, it is determined whether the posture of the mobile phone 10 is a vertical posture or a horizontal posture. The posture may be determined based on whether the value of the sensor data exceeds a predetermined threshold value indicating the vertical orientation or the horizontal orientation. Here, as shown in FIG. 3, the vertically oriented posture of the mobile phone 10 means that the long side of the generally rectangular mobile phone 10 extends in the direction away from the user or in the vertical direction, and the short side is the user's This is a posture of the mobile phone 10 arranged to extend in the left-right direction. On the other hand, as shown in FIG. 4, the horizontal orientation of the mobile phone 10 means that the short side of the mobile phone 10 extends away from the user or in the vertical direction, and the long side extends in the left-right direction of the user. Is the posture of the mobile phone 10 arranged in

  When the orientation of the mobile phone 10 is the portrait orientation, the image 100 displayed on the panel 22 is selected as the image to be printed, that is, the transmission image to be transmitted to the MFP 50, and the image Is stored in the storage unit 14. On the other hand, when the orientation of the mobile phone 10 is a landscape orientation, all images 100 of content data in a predetermined range including the image 100 displayed on the panel 22 are selected as transmission images, and all of the images 100 are selected. Information about the image is stored in the storage unit 14.

  The sensor data output from the tilt sensor 26 is stored in the storage unit 14 every time the value of the sensor data changes, that is, every time the attitude of the mobile phone 10 changes. Then, the attitude of the mobile phone 10 is determined based on the sensor data stored in the storage unit 14 when the distance between the mobile phone 10 and the MFP 50 is within the communication range of the NFC wireless communication 92. The transmission image is selected according to the attitude of the mobile phone 10 that has been determined. That is, the transmission image is selected based on the attitude of the mobile phone 10 when the mobile phone 10 enters the range of the wireless communication 92 due to the approach of the mobile phone 10 to the MFP 50. Incidentally, when the mobile phone 10 enters the range of the wireless communication 92, the print application 32a acquires event data output via the OS 32b. For this reason, the transmission image is selected based on the attitude of the mobile phone 10 when the CPU 12 acquires the event data.

  When a transmission image is selected in accordance with the attitude of the mobile phone 10, a screen for displaying the selected transmission image, that is, a screen on which the user can recognize the selected transmission image is displayed on the panel 22. The Specifically, when an image displayed on the panel 22 is selected as a transmission image, “This Page Selected” is displayed on the panel 22 as shown in FIG. Thereby, the user can recognize that the image displayed on the panel 22 is selected as the transmission image. When all the images of the content data including the image displayed on the panel 22 are selected as the transmission images, “All Page Selected” is displayed on the panel 22 as shown in FIG. Thereby, the user can recognize that all the images of the content data have been selected as the transmission images.

  Further, when the transmission image is selected according to the attitude of the mobile phone 10, the above-described handover process is executed on condition that a predetermined condition is satisfied, and the image data of the selected transmission image is The data is transmitted to the MFP 50 through WFD wireless communication 90. Specifically, when the mobile phone 10 repeatedly enters the range of the NFC wireless communication 92 within a predetermined time, that is, when the user approaches the MFP 50 of the mobile phone 10 repeatedly within the predetermined time. In the case (hereinafter, described as “when double touch is performed”), it is determined that the predetermined condition is satisfied. Hereinafter, a case where a double touch is performed within a predetermined time will be described with reference to the sequence diagram shown in FIG.

  First, when the mobile phone 10 enters the range of the wireless communication 92, the print application 32a acquires event data output via the OS 32b (M100). When the print application 32a acquires event data, as described above, a transmission image is selected according to the attitude of the mobile phone 10, and a screen on which the user can recognize the selected transmission image is displayed on the panel 22. (M102). Further, the print application 32a stores the acquisition time of the acquired event data in the storage unit 14 (M104).

  Subsequently, when the mobile phone 10 enters the wireless communication 92 again, the print application 32a obtains event data output via the OS 32b again (M106). Then, the print application 32a compares the acquisition time of the event data acquired this time with the acquisition time of the event data stored in the storage unit 14, that is, the acquisition time of the event data acquired last time (M108). If the difference between the two acquisition times is within a predetermined time, the above handover process is executed (M110 to M114). Then, the print application 32a transmits the image data of the transmission image to the MFP 50 through the WFD wireless communication 90 (M116). As a result, the MFP 50 performs a printing process based on the image data of the received transmission image.

  In addition, when event data is not acquired in M106, and the acquisition time of event data acquired this time in M108 and the acquisition time of event data acquired last time are compared, and the difference between the two acquisition times is a predetermined time. If it exceeds, it is determined that the predetermined condition is not satisfied. When it is determined that the predetermined condition is not satisfied, when the mobile phone 10 enters the range of the wireless communication 92 (M100), from the screen display (M102) where the selected transmission image can be recognized by the user. It will be redone.

  As described above, the user of the mobile phone 10 can select the transmission image and cause the MFP 50 to print the selected image simply by changing the posture of the mobile phone 10 and causing the mobile phone 10 to approach the MFP 50. It becomes possible. That is, in the mobile phone 10, user operations such as selection of a transmission image can be omitted, and user convenience is improved.

  In addition, a handover process and transmission of image data to the MFP 50 are performed on condition that a double touch is performed within a predetermined time. Accordingly, since the printing process is performed only when the user intends to perform printing and the mobile phone 10 is brought close to the MFP 50, it is possible to suppress the occurrence of the printing process due to an erroneous operation.

<Print application>
The printing process described above is performed by the CPU 12 of the mobile phone 10 executing the print application 32a. A flow for printing an image selected according to the attitude of the mobile phone 10 by the MFP 50 will be described below with reference to FIGS. 6 to 8.

  When the mobile phone 10 is turned on and the print application 32a is activated, the main flow process is started. In S100 of the main flow, the CPU 12 displays on the panel 22 the image 100 based on the image data constituting the content data in a predetermined range. As described in <Browsing Images on Mobile Phone>, when the return button 102 and the feed button 104 are operated, the CPU 12 displays an image 100 based on another image data on the panel 22. That is, the image data of the image selected by the user is output via the OS 32a. Then, the process proceeds to S102.

  In S <b> 102, the CPU 12 determines whether sensor data output from the tilt sensor 26 has been acquired. That is, it is determined whether the data generated by acquiring the center data output from the tilt sensor 26 is acquired via the OS 32b. If sensor data has not been acquired (S102: NO), the process of S102 is repeated. On the other hand, when the sensor data is acquired (S102: YES), the process proceeds to S104.

  In S104, the CPU 12 determines whether or not the attitude of the mobile phone 10 has changed. That is, as described in <Printing process according to the attitude of the mobile phone>, the CPU 12 determines whether the value of the acquired sensor data has changed, and if the value of the sensor data has changed, the CPU 12 It is determined that the posture of the telephone 10 has changed. If the posture of the mobile phone 10 has not changed (S104: NO), the process proceeds to S107. On the other hand, if the posture of the mobile phone 10 has changed (S104: YES), the process proceeds to S106.

  In S106, the CPU 12 outputs data for storing the acquired sensor data in the storage unit 14 via the OS 32b. Then, the process proceeds to S107. In S <b> 107, the CPU 12 determines whether or not the mobile phone 10 has entered the range of the NFC wireless communication 92. In other words, as described in <Printing Process According to Attitude of Mobile Phone>, has the CPU 12 acquired event data output by the OS 32b when the mobile phone 10 enters the range of the NFC wireless communication 92? Determine whether or not.

  If event data has not been acquired (S107: NO), the process returns to S102. On the other hand, if event data has been acquired (S107: YES), the process proceeds to S108. In S <b> 108, the CPU 12 determines the attitude of the mobile phone 10 based on the sensor data stored in the storage unit 14 and determines the attitude of the mobile phone 10. When the posture of the mobile phone 10 is a landscape orientation (S108: landscape orientation), the process proceeds to S110. In S <b> 110, the CPU 12 stores all image data of a predetermined range of content data including the image 100 displayed on the panel 22 as an image to be transmitted to the MFP 50. That is, data for storing the identification information of all the image data of the content data including the image 100 displayed on the panel 22 in the storage unit 14 is output via the OS 32b. Then, the process proceeds to S118.

On the other hand, when the orientation of the mobile phone 10 is the portrait orientation (S108: portrait orientation), the process proceeds to S114. In S <b> 114, the CPU 12 stores the image data of the image 100 displayed on the panel 22 as an image to be transmitted to the MFP 50. That is, data for storing the identification information of the image data of the image 100 displayed on the panel 22 in the storage unit 14 is output via the OS 32b. Then, the process proceeds to S118.

  In S <b> 118, the CPU 12 displays the printing mode of the image selected as the image to be transmitted to the MFP 50 on the panel 22. Specifically, as described in <Printing Processing According to Mobile Phone Attitude>, when an image displayed on the panel 22 is selected as an image to be transmitted to the MFP 50, the CPU 12 selects “This Page Selected”. ”Is output via the OS 32b. When all the content data images are selected as images to be transmitted to the MFP 50, “All Page Selected” and data to be displayed on the panel 22 are output via the OS 32b. Then, the process proceeds to S120.

  In S120, the CPU 12 determines whether or not a predetermined condition is satisfied. Specifically, as described in <Printing Processing According to Mobile Phone Attitude>, the CPU 12 determines event data output by the OS 32b when the mobile phone 10 enters the range of the NFC wireless communication 92 as predetermined. It is determined whether or not it has been acquired twice within the time. That is, when event data is acquired again within a predetermined time after acquiring event data in S107, it is determined that a predetermined condition is satisfied.

  If the predetermined condition is not satisfied (S120: NO), the process returns to S102. On the other hand, if the predetermined condition is satisfied (S120: YES), the process proceeds to S122. In S122, the CPU 12 executes the process described in <Handover process>. Then, the process proceeds to S124. In S <b> 124, the CPU 12 transmits the image data stored in the storage unit 14 as an image to be transmitted to the MFP 50 and an image print command based on the image data to the MFP 50 through the WFD wireless communication 90. In other words, the CPU 12 outputs the image data and an image print command based on the image data via the OS 32b so that the wireless LAN I / F 18 transmits to the MFP 50 through the WFD wireless communication 90. Then, the execution of the print application 32a ends.

Second Embodiment
An operation of the communication system 1 according to the second embodiment will be described. In addition, since the structure of the communication system 1 in 2nd Embodiment is the same as the structure of the communication system 1 in 1st Embodiment, description is abbreviate | omitted here.

  In the communication system 1 of the first embodiment, when a double touch is performed within a predetermined time, execution of a handover process and transmission of image data of a transmission image to the MFP 50 are performed. In the communication system 1, when the approaching operation of the mobile phone 10 by the user to the MFP 50 continues for a predetermined time (hereinafter, sometimes described as “when a long touch is performed”), the handover process is executed and Then, the image data of the transmission image is transmitted to the MFP 50. The case where the long touch is performed means that the mobile phone 10 is continuously present within a predetermined time within the range of the NFC wireless communication 92, and the sequence diagram shown in FIG. Will be described.

  First, when the mobile phone 10 enters the range of the wireless communication 92, the print application 32a acquires event data output via the OS 32b (M200). When the print application 32a acquires the event data, a transmission image is selected according to the attitude of the mobile phone 10 and a screen on which the user can recognize the selected transmission image is displayed on the panel as in the first embodiment. 22 (M202).

  Subsequently, the print application 32a periodically acquires data indicating whether the mobile phone 10 exists within the range of the wireless communication 92 via the OS 32b, for example, every 10 milliseconds. Based on the acquired data, it is determined whether or not it has been confirmed that the mobile phone 10 exists within the range of the wireless communication 92 until one second has elapsed since the event data was acquired (M204). Then, when the mobile phone 10 exists in the range of the wireless communication 92 until 1 second has elapsed since the acquisition of the event data, the print application 32a sets the SSID of the mobile phone 10 to the NFC wireless communication 92. To the MFP 50. At this time, when the mobile phone 10 is within the range of the wireless communication 92, the transmitted SSID of the mobile phone 10 is received by the MFP 50, and the MFP 50 receives the SSID of the mobile phone 10 and receives the SSID of the MFP 50. The SSID is returned to the mobile phone 10 (M206). That is, when the mobile phone 10 is continuously present within the range of the wireless communication 92 for 1 second, the SSID of the transmitted mobile phone 10 is received by the MFP 50 and the handover process is executed. When the telephone 10 is not continuously present within the range of the wireless communication 92 for one second, the transmitted SSID of the mobile telephone 10 is not received by the MFP 50 and the handover process is not executed.

  When the SSID of the MFP 50 is returned to the mobile phone 10, WFD wireless communication 90 is established (M 210), and image data is transmitted from the mobile phone 10 to the MFP 50 using the wireless communication 90. As described above, in the communication system 1 of the second embodiment, on the condition that the mobile phone 10 is continuously present within a predetermined time within the range of the NFC wireless communication 92, Then, the image data of the transmission image is transmitted to the MFP 50.

  As a result, in the second embodiment as well, as in the first embodiment, it is possible to select a transmission image and cause the MFP 50 to print the selected image by simply bringing the mobile phone 10 close to the MFP 50. User convenience is improved. Further, when a long touch is performed, the handover process and the transmission of the image data to the MFP 50 are performed, so that it is possible to suppress the occurrence of a printing process due to an erroneous operation as in the first embodiment. Become.

<Third Embodiment>
An operation of the communication system 1 according to the third embodiment will be described. In addition, since the structure of the communication system 1 in 3rd Embodiment is the same as the structure of the communication system 1 in 1st Embodiment, description is abbreviate | omitted here.

  In the communication system 1 of the first embodiment, the determination of double touch is performed by the mobile phone 10, but in the communication system 1 of the third embodiment, it is performed by the MFP 50. A case where determination of double touch is performed by the MFP 50 will be described with reference to a sequence diagram shown in FIG.

  First, when the mobile phone 10 enters the range of the wireless communication 92, the print application 32a acquires event data output via the OS 32b (M300). When the print application 32a acquires the event data, a transmission image is selected according to the attitude of the mobile phone 10 and a screen on which the user can recognize the selected transmission image is displayed on the panel as in the first embodiment. 22 (M302). Then, the print application 32a transmits a message indicating that the event data has been acquired to the MFP 50 through the NFC wireless communication 92 (M304).

  Upon receiving the message, the MFP 50 stores the message acquisition time (M306). Subsequently, when the mobile phone 10 reenters the range of the wireless communication 92, the print application 32a again acquires event data output via the OS 32b (M308). Then, the print application 32a transmits again a message indicating that the event data has been acquired to the MFP 50 through the NFC wireless communication 92 (M310).

  The MFP 50 compares the message acquisition time acquired this time with the stored message acquisition time, that is, the previous message acquisition time (M312). It is determined whether or not the difference between the two acquisition times is within a predetermined time. Then, the determination result is transmitted to the mobile phone 10 by the NFC wireless communication 92 (M314). When the difference between the two acquisition times is within a predetermined time in the transmitted determination result, the handover process is executed (M316 to M320). Then, the print application 32a transmits the image data to the MFP 50 through the WFD wireless communication 90 (M322). As a result, the MFP 50 performs a printing process based on the image data of the received transmission image. As described above, the double touch can be determined appropriately by the MFP 50 as in the first embodiment.

<Modification>
In the present embodiment, when all images of content data are selected as transmission images, “All Page Selected” is displayed on the panel 22, but as shown in FIG. 11, all images of content data are displayed. 100 can be displayed on the panel 22. As a result, the user can view the selected image 100 and recognize that all the images of the content data have been selected as transmission images. It is also possible to display all the images 100 of the content data on the panel 22 without displaying “All Page Selected”.

  Further, in the mobile phone 10 of the present embodiment, the sensor data of the tilt sensor 26 is stored whenever the posture of the mobile phone 10 changes, and is stored when the mobile phone 10 enters the range of the wireless communication 92. Although the attitude of the mobile phone 10 is determined based on the sensor data that is stored, the attitude of the mobile phone 10 can be determined by various methods. For example, even when the mobile phone 10 enters the range of the wireless communication 92, the print application 32a acquires sensor data via the OS 32b, and the posture of the mobile phone 10 is determined based on the acquired sensor data. Good. Furthermore, after the mobile phone 10 enters the range of the wireless communication 92, sensor data may be periodically acquired, and the attitude of the mobile phone 10 may be determined based on the acquired sensor data. That is, the change in posture of the mobile phone 10 after the mobile phone 10 enters the range of the wireless communication 92 is utilized for selection of a transmission image. The sensor data at this time may be automatically output from the inclination sensor 26 at a predetermined interval, or may be acquired by the print application 32a from the inclination sensor 26 actively through the OS 32b. Good.

  Further, in the mobile phone 10 of the present embodiment, whether or not the mobile phone 10 has entered the range of the wireless communication 92 is determined based on event data generated by the mobile phone 10 entering the range of the wireless communication 92. Although it is determined depending on whether or not it has been acquired, it can be determined by various methods. For example, the determination may be made based on whether or not data generated when the NFC wireless communication 92 is established is acquired.

  Further, whether or not the mobile phone 10 has entered the wireless communication 92 multiple times is determined by whether or not data generated when the NFC wireless communication 92 is established is acquired multiple times. Alternatively, the determination may be made based on whether or not the data generated when the NFC wireless communication 92 is established a plurality of times is acquired. Furthermore, after acquiring the data that occurs when the NFC wireless communication 92 is established, the data that is generated when the NFC wireless communication 92 is not established is acquired. When data generated when the wireless communication 92 is established is acquired, it is possible to determine that the mobile phone 10 has entered the wireless communication 92 multiple times.

  6 to 8 executed by the print application 32a, the changed attitude of the mobile phone 10 may be stored instead of the sensor data in S106. At that time, in S108, the attitude of the mobile phone 10 is determined based on the changed attitude of the mobile phone 10.

  In addition, the mobile terminal that can select a transmission image according to the attitude of the mobile phone 10 is not limited to the mobile phone 10 and may be a tablet device, a smartphone, or the like.

  Further, the apparatus that performs the printing process of the image selected according to the attitude of the mobile phone 10 is not limited to the MFP 50, and is not limited as long as it is a printable apparatus.

  The technique of the present invention can be applied not only to printing processing but also to various image processing. Specifically, the present invention can be applied to various image processing such as scanning, faxing, copying, 3D printing, and 3D scanning.

  In the present embodiment, NFC wireless communication is employed as the proximity wireless communication, but wireless communication such as TransferJet (registered trademark) can also be employed. In this case, the wireless communication established by the handover process can employ various wireless communication methods that are faster than the transfer jet wireless communication. In this case, the wireless communication established by the handover process can employ various wireless communication schemes that have a longer communicable distance than the TransferJet wireless communication. In addition, TransferJet wireless communication may be used, and image information and the like may be transmitted / received by TransferJet wireless communication without handover.

  In the mobile phone 10 of the present embodiment, the case where the CPU 12 executed based on the print application 32a performs various processes has been described. However, it is not limited to this form. The CPU 12 executed based on the print application 32a may issue an instruction to perform various processes to the OS 32b, other systems, and hardware configurations.

  In the above embodiment, the flow shown in FIGS. 6 to 8 is executed by executing the print application 32a. However, in the flow, the processes of S104, S106, and S118 to S124 may not be performed. If the above process is not performed, the process proceeds to S107 when sensor data is acquired (S102: YES). Further, after the process of S114 or S110 is completed, the flow in which the processes of S104, S106, and S118 to S124 are not performed is completed. It should be noted that not all the processes of S104, S106, and S118 to S124 are performed, but it is also possible to have a flow in which any process of S104, S106, and S118 to S124 is arbitrarily added.

  In addition, the technical elements described in the present specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  The mobile phone 10 is an example of a mobile terminal. The CPU 12 is an example of a computer and a processor. The storage unit 14 is an example of a storage unit. The wireless LAN I / F 18 is an example of a long distance communication unit. The NFC I / F 20 is an example of a close proximity wireless communication unit. The panel 22 is an example of a display unit. The tilt sensor 26 is an example of a sensor. The print application 32a is an example of a program. The MFP 50 is an example of an image processing apparatus. The return button 102 and the feed button 104 are an example of a reception unit.

  The CPU 12 that executes S102 is an example of a sensor information acquisition unit. The CPU 12 that executes S106 is an example of a sensor information storage unit. The CPU 12 that executes S107 to S114 is an example of an image information determination unit. The CPU 12 that executes S118 is an example of display image information output means. The CPU 12 that executes S120 is an example of a determination unit. The CPU 12 that executes S124 is an example of a transmission image information output unit.

  Each program may be composed of a single program module, or may be composed of a plurality of program modules. In addition, each example may have another replaceable configuration and is within the scope of the present invention. It may be a computer (CPU 12) that executes processing based on a print processing program (such as the print application 32a), or a computer that executes processing based on a program other than the print processing program, such as an operating system or other applications or programs. It may be a hardware configuration (panel 22 or the like) that operates according to a computer instruction, or may be a configuration in which the computer and the hardware configuration are linked. Of course, it may be a computer that executes processes by linking processes based on a plurality of programs, or may have a hardware configuration that operates according to instructions from a computer that executes processes by linking processes based on a plurality of programs. Good.

  10: mobile phone, 12: CPU, 14: storage unit, 18: wireless LAN I / F, 20: NFC I / F, 22: panel, 26: tilt sensor, 32a: printing application, 50: MFP, 102: return button, 104: Feed button

Claims (10)

A close proximity wireless communication unit for performing close proximity wireless communication with an image processing apparatus existing within a communication range;
A sensor that outputs sensor information based on the attitude of the mobile terminal;
A storage unit for storing an image information set capable of including a plurality of pieces of image information;
A computer-readable program comprising a portable terminal comprising:
The computer,
Sensor information acquisition means for acquiring sensor information output by the sensor;
Out of the plurality of pieces of image information included in the image information set stored in the storage unit, transmission image information that is image information to be transmitted to the image processing device is within the communication range of the proximity wireless communication. Image information determining means for determining based on the attitude of the portable terminal indicated by the sensor information acquired by the sensor information acquiring means when the image processing apparatus exists;
A program characterized by making it function. The computer,
The sensor information acquired by the sensor information acquisition unit functions as a sensor information storage unit that is stored in the storage unit every time the attitude of the mobile terminal indicated by the sensor information acquired by the sensor information acquisition unit changes. ,
The image information determining means includes
Determining the transmission image information based on an attitude of the portable terminal indicated by sensor information stored in the storage unit when the image processing apparatus exists within a communication range of the close proximity wireless communication; The program according to claim 1, characterized in that: The image information determining means includes
When the attitude of the portable terminal indicated by the sensor information acquired by the sensor information acquisition unit when the image processing apparatus exists within the communication range of the proximity wireless communication is the first attitude, the image All of the plurality of pieces of image information included in the information set are determined as the transmission image information, and acquired by the sensor information acquisition unit when the image processing apparatus exists within the communication range of the close proximity wireless communication. When the attitude of the mobile terminal indicated by the sensor information is the second attitude, a part of the plurality of pieces of image information included in the image information set is determined as the transmission image information. The program according to claim 1 or 2, characterized by: The portable terminal is
A reception unit that receives a user operation for selecting arbitrary image information from the plurality of pieces of image information included in the image information set;
The image information determining means includes
When the attitude of the portable terminal indicated by the sensor information acquired by the sensor information acquisition means when the image processing apparatus exists within the communication range of the proximity wireless communication is the second attitude, 4. The program according to claim 3, wherein image information selected by a user operation received by the receiving unit among the plurality of pieces of image information included in the image information set is determined as the transmission image information. . The computer,
Determination means for determining whether or not a condition for confirming transmission of the transmission image information to the image processing apparatus is satisfied;
When the transmission image information is determined by the image information determination unit, and the determination unit determines that a condition for confirming transmission of the transmission image information to the image processing device is satisfied, Transmission image information output means for causing the image processing apparatus to output the transmission image information determined by the image information determination means;
The program according to any one of claims 1 to 4, wherein the program is made to function. The determination means includes
A condition for confirming transmission of the transmission image information to the image processing apparatus is satisfied on the condition that the image processing apparatus has entered the communication range of the close proximity wireless communication a plurality of times within a predetermined time. The program according to claim 5, wherein the program is determined to be. The determination means includes
For confirming transmission of the transmission image information to the image processing device on condition that the image processing device is continuously present for a predetermined time within the communication range of the close proximity wireless communication 6. The program according to claim 5, wherein it is determined that the condition is satisfied. The portable terminal is
A long-distance wireless communication unit that performs long-distance wireless communication with the image processing apparatus having a longer communication distance than the proximity wireless communication by the near-field wireless communication unit;
The transmission image information output means includes
When the transmission image information is determined by the image information determination unit, and the determination unit determines that a condition for confirming transmission of the transmission image information to the image processing device is satisfied, The program according to any one of claims 5 to 7, wherein the transmission image information determined by the image information determination unit is output to the image processing device via the long-distance wireless communication. . The portable terminal is
A display unit for displaying an image;
The computer,
An image for displaying, on the display unit, an image capable of recognizing the transmission image information determined by the image information determination means when the image processing apparatus exists within the communication range of the close proximity wireless communication 9. The program according to claim 1, wherein the program functions as display image information output means for outputting information. A close proximity wireless communication unit for performing close proximity wireless communication with an image processing apparatus existing within a communication range;
A sensor that outputs sensor information based on the attitude of the mobile terminal;
A storage unit for storing an image information set capable of including a plurality of pieces of image information;
A processor;
A mobile terminal comprising:
The processor is
Sensor information acquisition means for acquiring sensor information output by the sensor;
Out of the plurality of pieces of image information included in the image information set stored in the storage unit, transmission image information that is image information to be transmitted to the image processing device is within the communication range of the proximity wireless communication. Image information determining means for determining based on the attitude of the portable terminal indicated by the sensor information acquired by the sensor information acquiring means when the image processing apparatus exists;
A portable terminal characterized by functioning.

Images