WO2013032000A1 - Information processing device, information processing system, server, information processing method, and computer program - Google Patents

Abstract

The objective of the present invention is to improve real-time capability when sharing display of handwritten information among a plurality of information processing devices. The present invention is provided with a coordinate information input unit (11) into which coordinate information is input, a sample coordinate extraction unit (12) for extracting sample coordinates satisfying extraction criteria among the coordinate information which have been input, a sample coordinate transceiving unit (13) for transmitting and receiving the sample coordinates to and from another information processing device, a handwritten information display unit (14) for displaying handwritten information representing a trajectory of the sample coordinates, a display evaluation information generation unit (15) for generating display evaluation information related to time required from reception of the sample coordinates until completion of display of the handwritten information based on the coordinates, a display evaluation information transceiving unit (16) for transmitting and receiving the display evaluation information to and from the other information processing device, and an extraction criteria modification unit (17) for modifying extraction criteria so as to reduce extraction frequency of the sample coordinates if the display evaluation information at the other information processing device do not satisfy permissible conditions for delay.

Description

Information processing apparatus, information processing system, server, information processing method, and computer program

The present invention relates to an information processing apparatus, an information processing system, a server, an information processing method, and a computer program that share and display input handwritten information with other information processing apparatuses.

2. Description of the Related Art In recent years, a system that shares and displays handwritten information input in a certain information processing apparatus by a plurality of information processing apparatuses is well known (for example, see Patent Document 1). Here, handwritten information refers to a locus of coordinate information input via an input device such as a pen tablet or a touch panel that can input coordinate information on the display screen.
As such an information processing device, there is an information processing device that obtains sample coordinates by sampling coordinate information input from an input device at a predetermined sampling period. When the information processing apparatus acquires sample coordinates for a predetermined number of samples, the information processing apparatus calculates a curve based on the sample coordinates and displays the calculated curve as handwritten information. At this time, the information processing apparatus changes the predetermined number of samples according to the size of the area where handwritten information is input or the amplitude of the handwritten information (see, for example, Patent Document 2).
As such an information processing apparatus, there is an information processing apparatus that adjusts a sampling rate of coordinate information input from an input apparatus. This information processing device is based on the elapsed time from the start of handwritten information input, the input speed of handwritten information, the CPU usage rate in other information processing devices that share handwritten information, the priority among information processing devices that share handwritten information, and the like. Accordingly, the sampling rate is adjusted (see, for example, Patent Document 3).
JP 2010-118047 A Japanese Patent No. 3,497,587 JP 2000-057094 A

In the system for sharing and displaying handwritten information as described above, the information processing apparatus to which the handwritten information is input transmits sample coordinates to another information processing apparatus. At this time, when the time required for the display processing of the handwritten information based on the received sample coordinates becomes longer in another information processing apparatus, the real-time property of the shared display is deteriorated.
Patent Document 1 and Patent Document 2 do not describe improving the real-time property of such shared display.
Patent Document 3 describes that the sampling rate is adjusted according to the CPU usage rate of other information processing apparatuses. However, the CPU usage rate of other information processing apparatuses is not necessarily related to the time required for the display processing of handwritten information. That is, in other information processing apparatuses, the CPU usage rate may be low even if it takes a long time to display the handwritten information based on the received sample coordinates. In this case, since the information processing apparatus described in Patent Document 3 does not adjust the sampling rate, the display processing time of handwritten information in another information processing apparatus cannot be reduced. Therefore, the information processing apparatus described in Patent Literature 3 may not be able to improve the real-time property of shared display.
The present invention has been made to solve the above-described problems, and provides a technique capable of further improving the real-time property of shared display in a system in which handwritten information is shared and displayed by a plurality of information processing devices. Objective.

An information processing apparatus according to the present invention includes a coordinate information input unit that receives coordinate information representing coordinates on a display screen, a sample coordinate extraction unit that extracts sample coordinates satisfying a predetermined extraction criterion from the coordinate information, and sample coordinates. A sample coordinate transmission / reception unit for transmitting / receiving to / from another information processing device, a handwritten information display unit for displaying handwritten information representing a locus of sample coordinates in the own device and a locus of sample coordinates in another information processing device, and others A display evaluation information generating unit for generating display evaluation information representing an evaluation relating to a display processing time required from completion of display of sample coordinates from the information processing apparatus to completion of display of handwritten information based on the sample coordinates, and other information processing Display evaluation information transmission / reception unit for transmitting / receiving display evaluation information to / from the device, and display evaluation information received from other information processing devices are predetermined. If not satisfied allowable delay condition, and a extraction reference changing unit that changes the extraction criterion to lower the extraction frequency of the sample coordinates in the sample coordinate extraction section.
The information processing system of the present invention includes a plurality of the above-described information processing devices, and the display evaluation information transmission / reception unit of each information processing device displays the display evaluation information related to the sample coordinates received by the sample coordinate transmission / reception unit. Based on the display evaluation information generated with respect to the sample coordinates in the information processing apparatus that is the transmission destination of the sample coordinates transmitted by the sample coordinate transmission / reception unit. Change the extraction criteria.
In addition, the server of the present invention, when the display evaluation information is received by the relay unit that transmits various types of information received from the information processing device described above to the other information processing devices described above, When the evaluation information does not satisfy the delay allowable condition, the extraction reference change information is generated, and the generated extraction reference change information is included in the display evaluation information, and then the other information processing source of the sample coordinates related to the display evaluation information A display evaluation information changing unit that causes the device to transmit to the relay unit.
Moreover, the information processing system of this invention is provided with the above-mentioned server and the above-mentioned information processing apparatus which transmits / receives the above-mentioned sample coordinate and the above-mentioned display evaluation information via the above-mentioned server.
Further, in the information processing method of the present invention, when coordinate information representing coordinates on the display screen is acquired, sample coordinates are extracted from the acquired coordinate information based on a predetermined extraction criterion, the sample coordinates are transmitted to another device, When handwritten information representing a locus of coordinates is displayed and sample coordinates extracted by another device are received, handwritten information representing the locus of the received sample coordinates is displayed, and handwritten information based on the sample coordinates is received from the reception of the sample coordinates The display evaluation information representing the evaluation related to the display processing time required to complete the display of the display is generated, the generated display evaluation information is transmitted to the other device, and the display evaluation information generated in the other device is received. When the display evaluation information does not satisfy the predetermined delay allowable condition, the extraction criterion is changed so as to reduce the extraction frequency of the sample coordinates.
Further, the computer program of the present invention includes a coordinate information acquisition process for acquiring coordinate information representing coordinates on the display screen, a sample coordinate extraction process for extracting sample coordinates from the acquired coordinate information based on a predetermined extraction criterion, a sample Sample coordinate transmission processing for transmitting coordinates to another device, handwritten information display processing for displaying handwritten information representing the locus of sample coordinates, sample coordinate reception processing for receiving sample coordinates extracted by other devices, and reception Display handwritten information display processing for displaying the handwritten information representing the locus of the sampled coordinates, and display evaluation information representing the evaluation regarding the display processing time required from the reception of the sample coordinates to the completion of displaying the handwritten information based on the sample coordinates Display evaluation information generation processing to be performed, and display evaluation to transmit the generated display evaluation information to another device Report transmission processing, display evaluation information reception processing for receiving display evaluation information generated in another device, and sampling coordinate extraction frequency when the received display evaluation information does not satisfy a predetermined delay tolerance condition The information processing apparatus executes an extraction criterion changing process for changing the extraction criterion.

The present invention can improve the real-time property of shared display in a system in which handwritten information is shared and displayed by a plurality of information processing apparatuses.

It is a block diagram which shows the structure of the information processing system which concerns on the 1st Embodiment of this invention. It is a hardware block diagram of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a functional block diagram of the information processing apparatus according to the first embodiment of the present invention. It is a flowchart explaining the operation | movement at the time of the handwritten information input of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart explaining the sample coordinate extraction operation | movement of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart explaining the operation | movement at the time of the handwritten information reception of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart explaining the operation | movement at the time of the display evaluation information reception of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the information processing system which concerns on the 2nd Embodiment of this invention. It is a hardware block diagram of each apparatus which comprises the information processing system which concerns on the 2nd Embodiment of this invention. It is a functional block diagram of each apparatus which comprises the information processing system which concerns on the 2nd Embodiment of this invention. It is a flowchart explaining operation | movement of the server which concerns on the 2nd Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
The configuration of the information processing system 100 according to the first embodiment of the present invention is shown in FIG. In FIG. 1, the information processing system 100 includes a plurality of information processing apparatuses 1. These information processing apparatuses 1 are connected to be communicable with each other via a network constituted by the Internet, a LAN (Local Area Network), a public line network, a wireless communication network, or a combination thereof. Although FIG. 1 shows two information processing apparatuses 1, this does not limit the number of information processing apparatuses included in the information processing system of the present invention.
Next, the hardware configuration of the information processing apparatus 1 is shown in FIG. In FIG. 2, the information processing apparatus 1 includes a CPU (Central Processing Unit) 1001, a RAM (Random Access Memory) 1002, a ROM (Read Only Memory) 1003, a storage device 1004 such as a hard disk drive, a network interface 1005, and the like. The computer device includes a display device 1006 and an input device 1007.
The ROM 1003 or the storage device 1004 stores a computer program and various data for causing the computer device to function as the information processing device 1 according to the first embodiment of the present invention.
The CPU 1001 reads the computer program and various data stored in the ROM 1003 or the storage device 1004 into the RAM 1002 and executes them.
The display device 1006 displays various information based on the control of the CPU 1001. The display device 1006 is configured by, for example, a liquid crystal display.
The input device 1007 is a device for inputting coordinate information in the display area of the display device 1006. The input device 1007 is configured by, for example, a pen tablet or a mouse. Further, the input device 1007 may be configured by a touch panel configured integrally with the display device 1006.
The network interface 1005 transmits and receives data via the network under the control of the CPU 1001.
Next, the functional block configuration of the information processing apparatus 1 is shown in FIG. 3, the information processing apparatus 1 includes a coordinate information input unit 11, a sample coordinate extraction unit 12, a sample coordinate transmission / reception unit 13, a handwritten information display unit 14, a display evaluation information generation unit 15, and display evaluation information transmission / reception. Unit 16 and extraction criterion changing unit 17. The coordinate information input unit 11 includes an input device 1007 and a CPU 1001 that reads a computer program and various data stored in the ROM 1003 or the storage device 1004 into the RAM 1002 and executes them. The sample coordinate extraction unit 12, the display evaluation information generation unit 15, and the extraction reference change unit 17 are configured by a CPU 1001 that reads a computer program and various data stored in the ROM 1003 or the storage device 1004 into the RAM 1002 and executes them. Is done. The sample coordinate transmission / reception unit 13 and the display evaluation information transmission / reception unit 16 are configured by a network interface 1005. The handwritten information display unit 14 includes a display device 1006 and a CPU 1001 that reads a computer program and various data stored in the ROM 1003 or the storage device 1004 into the RAM 1002 and executes them. Note that the hardware configuration configuring each functional block of the information processing apparatus 1 is not limited to the above configuration.
The coordinate information input unit 11 acquires coordinate information representing coordinates on the display screen of the display device 1006. For example, when the input device 1007 is configured by a touch panel, the coordinate information input unit 11 detects that the display screen of the display device 1006 is touched with a pen or a finger, and acquires coordinate information indicating the contact position on the display screen. To do.
The sample coordinate extraction unit 12 extracts sample coordinates satisfying a predetermined extraction criterion from the coordinate information acquired by the coordinate information input unit 11. Here, the extraction criterion may be, for example, whether or not a time based on a predetermined sampling rate has elapsed since the coordinate information extracted as the previous sample coordinates was acquired. Alternatively, the extraction criterion may be whether or not the distance between the coordinate information acquired by the coordinate information input unit 11 and the previously extracted sample coordinates is greater than or equal to a threshold value. Alternatively, the extraction criterion is the smaller of the angles formed by the straight line that passes through the coordinate information acquired by the coordinate information input unit 11 and the previously extracted sample coordinates, and the straight line that passes through the previously extracted sample coordinates and the previously extracted sample coordinates. It may be whether or not the angle (hereinafter also simply referred to as “the angle formed”) is equal to or greater than a threshold value. The extraction criterion may be based on a combination of several such criteria.
The sample coordinate transmission / reception unit 13 transmits / receives sample coordinates to / from another information processing apparatus 1.
The handwritten information display unit 14 displays handwritten information representing the locus of sample coordinates. Specifically, the handwritten information display unit 14 includes handwritten information representing the locus of sample coordinates extracted by the sample coordinate extracting unit 12 of the own device and the handwriting representing the locus of sample coordinates received from the other information processing apparatus 1. And information respectively. When sample coordinates are received from a plurality of other information processing apparatuses 1, the handwritten information display unit 14 displays handwritten information that represents the locus of the sample coordinates received from each information processing apparatus 1. Here, the handwritten information display unit 14 converts the sample coordinates received from the other information processing apparatus 1 into coordinates on the display screen of the display apparatus 1006 of the own apparatus, and then displays handwritten information representing the locus. Also good. For example, each information processing apparatus 1 may enable coordinate information conversion processing by transmitting and receiving coordinate ranges in the display apparatuses 1006 when starting shared display. Alternatively, each information processing apparatus 1 may set a shared display area in the display screen and set the same coordinate range in the set shared display area in advance. In this case, the coordinate information input unit 11 of each information processing apparatus 1 may convert the acquired coordinates into coordinates in the shared display area.
The handwritten information display unit 14 displays the handwritten information so that the sample coordinates extracted by the sample coordinate extracting unit 12 of the own device are continuous with the sample coordinates extracted by the sample coordinate extracting unit 12 of the own device every time the sample coordinate extracting unit 12 of the own device extracts the sample coordinates. Processing may be executed sequentially. Similarly, each time the sample coordinate is received from the other information processing device 1 by the sample coordinate transmitting / receiving unit 13, the handwritten information display unit 14 continues to the sample coordinate previously received from the information processing device 1. These display processes may be executed sequentially.
As described above, when the display processing is sequentially performed every time the sample coordinates are obtained, the handwritten information display unit 14 displays the sample coordinates obtained this time and the sample coordinates obtained last time in the apparatus from which the sample coordinates are extracted. You may make it display the line segment to connect.
The display evaluation information generation unit 15 generates display evaluation information related to the display processing time required from the reception of the sample coordinates from the other information processing apparatus 1 to the completion of the display of the handwritten information based on the sample coordinates. Here, the display evaluation information may be information representing the display processing time itself, for example. Alternatively, the display evaluation information may be statistical information such as the average, variance, maximum value, or minimum value of the above-described display processing times regarding a plurality of sample coordinates. Alternatively, the display evaluation information is the elapsed time from the reception time of a certain sample coordinate a to the reception time of another sample coordinate b, and the handwritten information based on the sample coordinate b from the display completion time of the handwritten information based on the sample coordinate a. It may be a difference from the elapsed time until the display completion time. Alternatively, the display evaluation information may be statistical information regarding such a difference in elapsed time. The plurality of sample coordinates herein may be a predetermined number of sample coordinates, or may be sample coordinates extracted during one stroke of a handwriting operation by the user.
For example, display evaluation information when the line segment between sample coordinates is sequentially displayed as described above by the handwritten information display unit 14 will be described. In this case, after the sample coordinate is received by the sample coordinate transmission / reception unit 13, the display evaluation information generation unit 15 connects a line segment connecting the sample coordinate and the sample coordinate obtained last time in the apparatus from which the sample coordinate is extracted. Is displayed as the display evaluation information. The elapsed time, the average, the variance, the maximum value, the minimum value, or the like required until the image is displayed by the handwritten information display unit 14 are generated.
The display evaluation information transmission / reception unit 16 transmits / receives display evaluation information to / from another information processing apparatus 1. At this time, if there are a plurality of other information processing apparatuses 1, the display evaluation information transmitting / receiving unit 16 displays the display on the other information processing apparatuses 1 that have transmitted the sample coordinates targeted by the corresponding display evaluation information. Send evaluation information. That is, the display evaluation information transmission / reception unit 16 receives the display evaluation information generated with respect to the sample coordinates in the other information processing apparatus 1 to which the sample coordinates are extracted from the coordinate information input in the own apparatus. become.
The extraction criterion changing unit 17 changes the extraction criterion so as to reduce the extraction frequency of the sample coordinates when the display evaluation information received from the other information processing apparatus 1 does not satisfy the predetermined delay allowable condition. Here, the allowable delay condition may be based on, for example, a threshold of elapsed time required from reception of sample coordinates in each device to completion of display of handwritten information based on the sample coordinates. For example, if the extraction criterion is based on a predetermined sampling rate, the extraction criterion changing unit 17 determines that the sampling rate is higher than before when the display evaluation information indicates that the above-described elapsed time exceeds the threshold value. You may change so that it may become low. Alternatively, if the extraction criterion is based on the threshold value of the distance between coordinates as described above, the extraction criterion changing unit 17 indicates that the display evaluation information indicates that the above-described elapsed time exceeds the threshold value. The distance threshold may be changed to be larger than before. Alternatively, if the extraction criterion is based on the angle between the straight lines passing between the coordinates as described above, the extraction criterion changing unit 17 indicates that the elapsed time exceeds the threshold value by the display evaluation information. If so, the angle threshold may be changed to be larger than before.
Further, the extraction criterion changing unit 17 may change the extraction criterion so as to increase the extraction frequency of the sample coordinates when the display evaluation information satisfies the delay allowable condition. For example, the extraction criterion changing unit 17 may change the sampling rate to be higher than before when the elapsed time is within a threshold. Alternatively, the extraction criterion changing unit 17 may change the distance threshold to be smaller than before when the elapsed time is within the threshold. Alternatively, the extraction criterion changing unit 17 may change the angle threshold to be smaller than before when the above-described elapsed time is within the threshold.
Note that the change rate of the sampling rate and various threshold values may be determined in advance, or may be calculated according to an excess width in which the elapsed time as the display evaluation information exceeds the threshold value as the delay allowable condition.
The operation of the information processing apparatus 1 configured as described above will be described.
First, the operation of the information processing apparatus 1 to which handwritten information has been input will be described with reference to FIG. FIG. 4 is a flowchart for explaining the operation of the information processing apparatus according to the first embodiment of the present invention when inputting handwritten information.
Here, first, the coordinate information input unit 11 acquires coordinate information by detecting contact with the input device 1007 (step S1).
Next, the sample coordinate extraction unit 12 determines whether or not the acquired coordinate information is a sample coordinate that satisfies the extraction criterion (step S2). A specific example of this step will be described later.
Here, when the acquired coordinate information does not satisfy the extraction criterion, the information processing apparatus 1 ends the operation when inputting handwritten information.
On the other hand, when the acquired coordinate information satisfies the extraction criterion, the sample coordinate transmitting / receiving unit 13 transmits the coordinate information as sample coordinates to the other information processing apparatus 1 (step S3).
Next, the handwritten information display unit 14 displays handwritten information based on the sample coordinates (step S4). For example, as described above, the handwritten information display unit 14 may display a line segment connecting the sample coordinates extracted this time and the sample coordinates extracted last time.
Above, description of operation | movement of the information processing apparatus 1 into which handwritten information was input is complete | finished.
Next, a specific example of the operation of the sample coordinate extraction unit 12 in step S2 will be described with reference to FIG. FIG. 5 is a flowchart for explaining the sample coordinate extraction operation of the information processing apparatus according to the first embodiment of the present invention. Here, an example will be described in which the sample coordinate extracting unit 12 extracts sample coordinates based on the distance between the coordinates and the angle formed between the straight lines connecting the coordinates.
Here, first, the sample coordinate extraction unit 12 determines whether or not the distance between the coordinates acquired in step S1 and the sample coordinates extracted last time is equal to or greater than a threshold (step S11).
If the distance is not greater than or equal to the threshold value, the sample coordinate extraction unit 12 determines that the coordinates do not satisfy the extraction criterion, and ends the extraction operation.
On the other hand, if this distance is greater than or equal to the threshold, the sample coordinate extracting unit 12 connects the straight line connecting the coordinates acquired in step S1 and the previously extracted sample coordinates to the straight line connecting the previously extracted sample coordinates and the previously extracted sample coordinates. It is determined whether or not the angle formed by is greater than or equal to a threshold value (step S12).
If the angle is not equal to or greater than the threshold value, the sample coordinate extraction unit 12 determines that the coordinates are not sample coordinates and ends the extraction operation.
On the other hand, if this angle is equal to or greater than the threshold, the sample coordinate extraction unit 12 determines that this coordinate is the sample coordinate (step S13), and ends the extraction operation.
Above, description of operation | movement of the sample coordinate extraction part 12 in step S2 is complete | finished. Here, the description has been given assuming that the sample coordinate extracting unit 12 extracts the coordinates as the sample coordinates when both the distance between the coordinates and the angle between the straight lines are equal to or greater than the threshold value, respectively. In addition, the sample coordinate extraction unit 12 may extract the coordinates as the sample coordinates when any one of the distance between the coordinates and the angle formed between the straight lines is equal to or greater than a threshold value. Alternatively, the sample coordinate extraction unit 12 may extract sample coordinates based on other extraction criteria or a combination thereof.
Next, the operation of the information processing apparatus 1 that has received handwritten information from another information processing apparatus 1 will be described with reference to FIG. FIG. 6 is a flowchart for explaining the operation of the information processing apparatus according to the first embodiment of the present invention when handwritten information is received.
Here, first, the sample coordinate transmitting / receiving unit 13 receives sample coordinates from another information processing apparatus 1 (step S21).
Next, the handwritten information display unit 14 displays handwritten information based on the sample coordinates (step S22). For example, as described above, the handwritten information display unit 14 displays a line segment connecting the sample coordinates received this time and the sample coordinates previously received from the other information processing apparatus 1 that has transmitted the sample coordinates. You may do it.
Next, the display evaluation information generation unit 15 generates display evaluation information representing evaluation related to the display process in step S22 (step S23). For example, the display evaluation information generation unit 15 uses the elapsed time from the reception time in step S21 to the time when the display process in step S22 is completed as the display evaluation information.
Next, the display evaluation information transmitting / receiving unit 16 transmits the generated display evaluation information to the information processing apparatus 1 that is the transmission source of the sample coordinates received in step S21 (step S24).
Above, description of operation | movement of the information processing apparatus 1 which received handwritten information is complete | finished.
Next, an operation of the information processing apparatus 1 that has received display evaluation information from another information processing apparatus 1 will be described with reference to FIG. FIG. 7 is a flowchart for explaining the operation when the display evaluation information is received by the information processing apparatus according to the first embodiment of the present invention.
Here, first, the display evaluation information receiving unit 16 receives display evaluation information from another information processing apparatus 1 (step S31).
Next, the extraction criterion changing unit 17 determines whether or not the received display evaluation information satisfies a delay allowable condition (step S32). For example, the extraction criterion changing unit 17 may determine whether the elapsed time from the reception time of the sample coordinates in the other information device 1 to the display completion time of the handwritten information based on the sample coordinates is within a threshold value. .
Here, when the display evaluation information does not satisfy the delay allowable condition, the extraction criterion changing unit 17 changes the extraction criterion so as to reduce the extraction frequency of the sample coordinates (step S33). For example, the extraction criterion changing unit 17 may increase the distance threshold and the angle threshold, respectively, more than before.
On the other hand, when the display evaluation information satisfies the delay tolerance condition, the extraction criterion changing unit 17 changes the extraction criterion so as to increase the extraction frequency of the sample coordinates (step S34). For example, the extraction criterion changing unit 17 may make the distance threshold and the angle threshold smaller than before.
Above, description of operation | movement of the information processing apparatus 1 which received display evaluation information is complete | finished.
Next, a specific example of the operation when a mobile phone terminal having a liquid crystal display with a touch panel is applied as the information processing apparatus 1 that operates as described above will be described. Here, description will be made assuming that handwritten information is shared between the mobile phone terminal 1A and the mobile phone terminal 1B. Note that the mobile phone terminal 1A and the mobile phone terminal 1B can communicate with each other via, for example, a 3G (3rd Generation) mobile communication network. Further, it is assumed that the mobile phone terminal 1A and the mobile phone terminal 1B each set a shared display area having the same coordinate range in the display screen.
In the following description, an operation on the touch panel detected by a device having the touch panel is referred to as an “event”. The event is, for example, an operation in which the pen or finger touches the touch panel, an operation in which the pen or finger moves while touching the touch panel, or an operation in which the pen or finger leaves the touch panel.
First, the coordinate information input unit 11 of the mobile phone terminal 1A detects a touch on the touch panel by the user A of the mobile phone terminal 1A as a DOWN event. At this time, when the user A continues to touch the touch panel, the coordinate information input unit 11 continuously detects the MOVE event. Further, when the user A lifts his / her finger from the touch panel, the coordinate information input unit 11 detects an UP event. Each of the DOWN event, the MOVE event, and the UP event includes coordinate information indicating the contact position of the user A on the touch panel, for example, [100, 258].
Next, every time an event occurs, the sample coordinate extraction unit 12 of the mobile phone terminal 1A collates the coordinate information included in the event with the extraction criterion, and extracts the matching information as sample coordinates. At this time, it is assumed that the sample coordinate extraction unit 12 of the mobile phone terminal 1A stores in advance a threshold value 20 for the distance between coordinates and a threshold value 45 degrees for the angle as extraction references.
Note that the sample coordinate extraction unit 12 of the mobile phone terminal 1A regards the DOWN event and the UP event as events indicating the start and end of one handwritten stroke, and the coordinate information included in these is based on the extraction criteria. Extract as sample coordinates without matching.
In this way, it is assumed that the sample coordinate extraction unit 12 of the mobile phone terminal 1A extracts [100, 100] and [124, 100] in order as sample coordinates.
Next, it is assumed that the coordinate information input unit 11 of the mobile phone terminal 1A has acquired coordinate information [124, 124] included in the MOVE event.
In this case, the distance between the newly acquired coordinates [124, 124] and the previous sample coordinates [124, 100] is 24. Also, a straight line connecting the newly acquired coordinates [124, 124] and the previous sample coordinates [124, 100], the previous sample coordinates [124, 100], and the second previous sample coordinates [100]. , 100] is 90 degrees. Therefore, since the distance 24 between the coordinates exceeds the threshold 20 and the angle formed between the straight lines connecting the coordinates exceeds the threshold 45 degrees, the sample coordinate extracting unit 12 of the mobile phone terminal 1A newly The acquired coordinates [124, 124] are extracted as sample coordinates.
Next, the sample coordinate transmitting / receiving unit 13 of the mobile phone terminal 1A transmits the extracted sample coordinates [124, 124] to the mobile phone terminal 1B.
Next, the handwritten information display unit 14 of the mobile phone terminal 1A displays a line segment connecting the previous sample coordinates [124, 100] and the new sample coordinates [124, 124].
Then, the sample coordinate transmission / reception unit 13 of the mobile phone terminal 1B receives the sample coordinates [124, 124] from the mobile phone terminal 1A.
Next, the handwritten information display unit 14 of the mobile phone terminal 1B displays a line segment connecting the sample coordinates [124, 100] received last time from the mobile phone terminal 1A and the sample coordinates [124, 124] received this time.
At the same time, the display evaluation information generation unit 15 of the mobile phone terminal 1B receives the sample coordinates [124, 124] until the display of the line segment connecting the sample coordinates [124, 100] and [124, 124] is completed. Measure the elapsed time. Here, it is assumed that the elapsed time is 200 milliseconds. Therefore, the display evaluation information generation unit 15 of the mobile phone terminal 1B generates display evaluation information including information of 200 milliseconds.
Next, the display evaluation information transmitting / receiving unit 16 of the mobile phone terminal 1B transmits the generated display evaluation information to the mobile phone terminal 1A.
Next, the display evaluation information transmitting / receiving unit 16 of the mobile phone terminal 1A receives the display evaluation information from the mobile phone terminal 1B. Here, it is assumed that the extraction criterion changing unit 17 of the mobile phone terminal 1A stores 100 milliseconds in advance as the threshold value of the allowable delay time. Therefore, the extraction criterion changing unit 17 of the mobile phone terminal 1A determines that 200 milliseconds included in the received display evaluation information exceeds the delay allowable condition threshold of 100 milliseconds. Therefore, the extraction reference changing unit 17 of the mobile phone terminal 1A changes the extraction reference distance threshold to 25 larger than 24 and also changes the angle threshold to 50 degrees larger than 45 degrees. Here, it is assumed that the change range of the threshold value of the extraction reference distance is predetermined to 1, and the change range of the threshold value of the extraction reference angle is predetermined to 5 degrees.
Then, the sample coordinate extraction unit 12 of the mobile phone terminal 1A performs an extraction process using each changed threshold value as a subsequent sample coordinate extraction reference.
This is the end of the description of the specific example.
Next, effects of the first exemplary embodiment of the present invention will be described.
The information processing apparatus and information processing system according to the first embodiment of the present invention can further improve the real-time property of shared display in a system that displays handwritten information shared by a plurality of information processing apparatuses.
The reason will be described. First, in an information processing apparatus to which handwritten information is input, a sample coordinate extraction unit extracts sample coordinates from input coordinates based on a predetermined extraction criterion and transmits the sample coordinates to another information processing apparatus. Then, in the information processing apparatus that has received the sample coordinates, the display evaluation information generation unit generates display evaluation information related to the display processing time taken from the reception of the sample coordinates to the completion of the display of the handwritten information based on the sample coordinates. The sample coordinates are transmitted to the information processing apparatus. Then, in the information processing apparatus that has received the display evaluation information, the extraction criterion changing unit changes the extraction criterion so as to reduce the sampling frequency of the sample coordinates when the display evaluation information does not satisfy the allowable delay condition.
As a result, when it takes time to display the handwritten information input in one information processing apparatus in another information processing apparatus, the information processing apparatus in which the handwritten information is input decreases the sampling frequency of the sample coordinates. become. As a result, in other information processing apparatuses, the reception frequency of the sample coordinates is reduced, and it is possible to prevent receiving the next sample coordinates before the display of the handwritten information based on the previously received sample coordinates is completed. Therefore, the real-time property of shared display is improved.
Furthermore, the information processing apparatus system and the information processing apparatus according to the first embodiment of the present invention further improve the real-time property of shared display when the handwritten information display unit sequentially performs display processing every time sample coordinates are obtained. Can be improved. In this case, the information processing apparatus according to the first embodiment of the present invention can also shorten the display processing time until the handwritten information input by the own apparatus is displayed by the own apparatus.
This is because the handwritten information display unit displays handwritten information so as to be continuous with the previously obtained sample coordinates every time the sample coordinates are obtained. Thereby, compared with the case where handwritten information based on a plurality of sample coordinates is obtained, display processing time from the input of the coordinates to the completion of displaying the handwritten information corresponding to the coordinates can be shortened. Furthermore, when the handwritten information display unit displays a line segment connecting the previously obtained sample coordinates and the currently obtained sample coordinates, the approximate curve calculation process based on a plurality of sample coordinates can be omitted. For this reason, the information processing apparatus system and the information processing apparatus according to the first embodiment of the present invention can further shorten the display processing time.
In the first embodiment, the example in which the extraction criterion changing unit determines the change content of the extraction criterion based on the display evaluation information has been described. However, the extraction criterion changing unit is an extraction that represents the change content of the extraction criterion. By receiving the display evaluation information including the reference change information, the extraction reference may be changed according to the extraction reference change information. In this case, the display evaluation information generation unit generates extraction reference change information in the device that is the source of the sample coordinates based on whether or not the generated display evaluation information satisfies the delay allowable condition, and the generated extraction reference change information May be included in the display evaluation information.
(Second Embodiment)
Next, a second embodiment of the present invention will be described in detail with reference to the drawings. In each drawing referred to in the description of the second embodiment, the same reference numerals are given to the same configuration and steps that operate in the same manner as in the first embodiment of the present invention. Detailed description on the form is omitted.
FIG. 8 shows the configuration of an information processing system 200 according to the second embodiment of the present invention. In FIG. 8, the information processing system 200 includes a plurality of information processing apparatuses 2 and servers 3. The information processing apparatus 2 and the server 3 are connected to a network constituted by the Internet, a LAN, a public line network, a wireless communication network, or a combination thereof. These information processing apparatuses 2 can communicate with each other via the server 3. That is, the server 3 can communicate with each information processing apparatus 2. Although FIG. 8 shows two information processing apparatuses 2 and one server 3, this does not limit the number of information processing apparatuses and servers included in the information processing system of the present invention.
Next, FIG. 9 shows a hardware configuration of each device constituting the information processing system 200. In FIG. 9, the information processing device 2 is configured by a computer device similar to the information processing device 1 according to the first embodiment of the present invention. The server 3 includes a computer device that includes a CPU 3001, a RAM 3002, a ROM 3003, a storage device 3004 such as a hard disk drive, and a network interface 3005.
The ROM 3003 or the storage device 3004 stores a computer program and various data for causing the computer device to function as the server 3 according to the second embodiment of the present invention.
The CPU 3001 reads the computer program and various data stored in the ROM 3003 or the storage device 3004 into the RAM 3002 and executes them.
The network interface 3005 transmits / receives data via the network under the control of the CPU 3001.
Next, a functional block configuration of each device constituting the information processing system 200 is shown in FIG. In FIG. 10, the information processing device 2 is different from the information processing device 1 according to the first embodiment of the present invention in that it replaces the sample coordinate transmission / reception unit 13 with a sample coordinate transmission / reception unit 23 and a display evaluation information transmission / reception unit 16. The display evaluation information transmission / reception unit 26 is replaced with an extraction reference change unit 27 and an extraction reference change unit 27 is provided instead of the extraction reference change unit 17. The server 3 includes a relay unit 31 and a display evaluation information change unit 32. Here, the relay unit 31 includes a network interface 3005. The display evaluation information changing unit 32 includes a CPU 3001 that reads a computer program and various data stored in the ROM 3003 or the storage device 3004 into the RAM 3002 and executes them. Note that the hardware configuration constituting each functional block of the server 3 is not limited to the above-described configuration.
First, functional blocks of the information processing apparatus 2 will be described.
The sample coordinate transmission / reception unit 23 transmits the sample coordinates extracted by the sample coordinate extraction unit 12 to the server 3 and receives the sample coordinates from the server 3.
The display evaluation information transmission / reception unit 26 transmits the display evaluation information generated by the display evaluation information generation unit 15 to the server 3 and receives the display evaluation information from the server 3.
The extraction criterion changing unit 27 changes the extraction criterion used in the sample coordinate extracting unit 12 based on the display evaluation information received from the server 3. Here, the display evaluation information received from the server 3 includes extraction criterion change information representing the change contents of the extraction criterion. Details of the display evaluation information received from the server 3 will be described later. For example, when the display criterion information includes extraction criterion change information that represents the content that lowers the sampling rate as the extraction criterion, the extraction criterion changing unit 27 changes the sampling rate lower than before. Alternatively, when the display evaluation information includes extraction reference change information that indicates the content for increasing the distance threshold as the extraction reference, the extraction reference changing unit 27 changes the distance threshold more than before. Alternatively, the extraction criterion changing unit 27 changes the angle threshold smaller than before when the display evaluation information includes extraction criterion changing information representing the content that reduces the angle threshold as the extraction criterion.
Next, functional blocks of the server 3 will be described.
The relay unit 31 transmits various information such as sample coordinates and display evaluation information received from the information processing apparatus 2 to the other information processing apparatuses 2.
The display evaluation information changing unit 32 determines whether or not the received display evaluation information satisfies a predetermined delay allowable condition. This allowable delay condition is determined in advance in the server 3. For example, the delay allowable condition may be a threshold value of the elapsed time required from the reception of the sample coordinates in the information processing apparatus 2 that is the transmission source of the display evaluation information to the completion of displaying the handwritten information based on the sample coordinates. Then, when the received display evaluation information does not satisfy the predetermined delay allowance condition, the display evaluation information change unit 32 extracts the extraction reference change information in the information processing apparatus 2 that is the transmission source of the sample coordinates related to the corresponding display evaluation information. Is generated. At this time, the display evaluation information changing unit 32 generates, as the extraction reference change information, the change contents of the extraction reference that lowers the sample coordinate extraction frequency. Then, the display evaluation information changing unit 32 includes the generated extraction reference change information in the display evaluation information, and then transmits the information to the relay unit 31 to the information processing apparatus 2 that has transmitted the sample coordinates related to the display evaluation information. Let
For example, the display evaluation information changing unit 32 further reduces the sampling rate of the sample coordinate extracting unit 12 in the information processing apparatus 2 that has transmitted the sample coordinates when the received display evaluation information does not satisfy the delay tolerance condition. The extraction criterion change information may be included in the display evaluation information. Alternatively, in such a case, the display evaluation information changing unit 32 sets the extraction reference change information with a content that further increases the distance threshold used in the sample coordinate extracting unit 12 in the information processing apparatus 2 that has transmitted the sample coordinates. You may make it include in display evaluation information. Alternatively, in such a case, the display evaluation information changing unit 32 sets the extraction reference change information with a content that further increases the angle threshold used in the sample coordinate extracting unit 12 in the information processing apparatus 2 that has transmitted the sample coordinates. You may make it include in display evaluation information.
Further, the display evaluation information changing unit 32 extracts the content that increases the extraction frequency of the sample coordinates in the information processing apparatus 2 that has transmitted the sample coordinates when the received display evaluation information satisfies a predetermined delay tolerance condition. The reference change information may be included in the display evaluation information.
Note that the display evaluation information changing unit 32 may include a predetermined change rate in the extraction reference change information as the change rate of the sampling rate and various threshold values. Alternatively, the display evaluation information changing unit 32 calculates a value corresponding to the excess width in which the elapsed time as the display evaluation information exceeds the threshold as the delay allowable condition as the change rate of the sampling rate and various threshold values, and the calculated change The width may be included in the extraction reference change information.
The operation of the information processing system 200 configured as described above will be described.
First, the operation of the information processing apparatus 2 to which handwritten information is input and the operation of the information processing apparatus 2 that has received the handwritten information are the same as the operation of the information processing apparatus 1 described with reference to FIGS. is there. However, in the second embodiment, the information processing device 2 transmits and receives various types of information to and from the server 3 instead of other information processing devices in step S3, step S21, and step S24.
Next, the operation of the server 3 will be described with reference to FIG. FIG. 11 is a flowchart for explaining the operation of the server 3 according to the second embodiment of the present invention.
Here, first, the relay unit 31 determines whether the received information is display evaluation information or sample coordinates (step S41).
Here, when the received information is the sample coordinates, the relay unit 31 transmits the received sample coordinates to other information processing apparatuses 2 other than the transmission source of the sample coordinates (step S42).
On the other hand, when the received information is display evaluation information, the display evaluation information changing unit 32 determines whether or not the display evaluation information satisfies a predetermined delay allowable condition (step S43).
Here, when the display evaluation information satisfies the delay tolerance condition, the display evaluation information changing unit 32 includes the extraction reference change information that increases the extraction frequency of the sample coordinates in the display evaluation information (step S44).
On the other hand, when the display evaluation information does not satisfy the allowable delay condition, the display evaluation information changing unit 32 includes the extraction reference change information that reduces the extraction frequency of the sample coordinates in the display evaluation information (step S45).
Next, the relay unit 31 transmits the display evaluation information changed by the display evaluation information changing unit 32 to the information processing apparatus 2 that is the transmission source of the sample coordinates related to the display evaluation (step S46).
Above, description of operation | movement of the server 3 is complete | finished.
Then, the information processing apparatus 2 that has received the display evaluation information from the server 3 changes the extraction criterion according to the extraction criterion change information included in the display evaluation information.
Next, effects of the second exemplary embodiment of the present invention will be described.
The information processing system and information processing apparatus according to the second embodiment of the present invention can further reduce the processing load of each information processing apparatus in the information processing system that improves the real-time property of shared display.
The reason is that the server is in charge of the process of determining the change contents of the extraction criterion based on whether or not the display evaluation information satisfies the allowable delay condition. This is because it is not necessary for each information processing apparatus to perform a process of determining the extraction criteria change content based on the content of the display evaluation information.
In the second embodiment of the present invention, the display evaluation information changing unit of the server may store delay tolerance conditions corresponding to various types of display evaluation information. Thereby, the second embodiment of the present invention easily copes with the case where the format of the display evaluation information is different in each device, and reduces the processing load of each information processing device in the information processing system that improves real-time performance. Can be reduced.
In the above-described embodiments of the present invention, the operations of the information processing apparatuses 1 and 2 and the server 3 described with reference to the flowcharts shown in FIGS. 4 to 7 and 11 are used as the computer program of the present invention. It may be stored in a storage device (storage medium) of a computer device, and the computer program may be read and executed by the CPU. In such a case, the present invention is constituted by a code representing such a computer program or the storage medium described above.
Moreover, each embodiment mentioned above can be implemented in combination as appropriate.
The present invention is not limited to the above-described embodiments, and can be implemented in various modes.
This application claims priority based on Japanese Patent Application No. 2011-190607 filed on September 1, 2011, and incorporates all of its disclosure.
A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.
(Appendix 1)
A coordinate information input unit for inputting coordinate information representing coordinates on the display screen;
A sample coordinate extraction unit that extracts sample coordinates satisfying a predetermined extraction criterion from the coordinate information;
A sample coordinate transmission / reception unit for transmitting / receiving the sample coordinates to / from another information processing apparatus;
A handwritten information display unit for displaying handwritten information representing the locus of the sample coordinates in the own apparatus and the locus of the sample coordinates in the other information processing apparatus;
A display evaluation information generating unit that generates display evaluation information representing an evaluation related to display processing time required from completion of display of handwritten information based on the sample coordinates after receiving the sample coordinates from the other information processing apparatus;
A display evaluation information transmitting / receiving unit that transmits and receives the display evaluation information to and from the other information processing apparatus;
An extraction criterion changing unit that changes the extraction criterion so as to reduce the sampling frequency of the sample coordinates in the sample coordinate extracting unit when the display evaluation information received from the other information processing apparatus does not satisfy a predetermined delay allowable condition. When,
An information processing apparatus comprising:
(Appendix 2)
The information according to appendix 1, wherein the handwritten information display unit sequentially executes a display process of handwritten information so as to be continued with the sample coordinates previously extracted in the device from which the sample coordinates are extracted each time the sample coordinates are obtained. Processing equipment.
(Appendix 3)
The handwritten information display unit displays the line segment connecting the sample coordinates previously extracted and the sample coordinates obtained this time in the device from which the sample coordinates are extracted each time the sample coordinates are obtained, The information processing apparatus according to appendix 2, which sequentially executes display processing of handwritten information.
(Appendix 4)
When the distance between the coordinate information input to the coordinate information input unit and the previously extracted sample coordinates is equal to or greater than a threshold, the sample coordinate extraction unit extracts the coordinate information as sample coordinates,
The extraction criterion changing unit changes any one of the thresholds of the distance to a larger one when the display evaluation information received from the other information processing apparatus does not satisfy the delay tolerance condition. The information processing apparatus described in 1.
(Appendix 5)
The sample coordinate extraction unit is smaller than an angle formed by the straight line that passes through the coordinate information input to the coordinate information input unit and the previously extracted sample coordinates, and the straight line that passes through the previously extracted sample coordinates and the sample coordinates extracted the last time. If the calculated angle is equal to or greater than a threshold, the coordinate information is extracted as sample coordinates,
The extraction criterion changing unit changes any one of the threshold values of the angle to a larger value when the display evaluation information received from the other information processing apparatus does not satisfy the delay allowable condition. The information processing apparatus described in 1.
(Appendix 6)
The sample coordinate extraction unit extracts the sample coordinates based on a sampling rate,
The extraction criterion changing unit changes the sampling rate to a lower one when the display evaluation information received from the other information processing apparatus does not satisfy the delay allowable condition. The information processing apparatus described.
(Appendix 7)
The information processing apparatus according to any one of supplementary notes 1 to 6, wherein the display evaluation information generation unit generates statistical information of the display processing time as the display evaluation information.
(Appendix 8)
The display evaluation information generation unit is configured to reduce the sample coordinate extraction frequency in the other information processing apparatus when the display evaluation information in the own apparatus does not satisfy the delay allowable condition. The extraction criteria change information representing the content to change the extraction criteria is generated in the display evaluation information,
The information processing apparatus according to any one of appendix 1 to appendix 7, wherein the extraction criterion changing unit changes the extraction criterion according to extraction criterion change information included in display evaluation information received from the other information processing device. .
(Appendix 9)
A plurality of information processing apparatuses according to any one of appendix 1 to appendix 8;
The display evaluation information transmission / reception unit of each information processing device transmits display evaluation information related to the sample coordinates received by the sample coordinate transmission / reception unit to the information processing device that is the transmission source of the sample coordinates,
The extraction criterion changing unit is configured to change the extraction criterion based on display evaluation information generated with respect to the sample coordinates in the information processing apparatus to which the sample coordinates transmitted by the sample coordinate transmitting / receiving unit are transmitted. .
(Appendix 10)
The sample coordinate transmission / reception unit performs transmission / reception of the sample coordinates with the other information processing apparatus via a server,
The information processing apparatus according to any one of appendix 1 to appendix 7, wherein the display evaluation information transmission / reception unit transmits / receives the sample coordinates to / from the other information processing apparatus via the server.
(Appendix 11)
A relay unit that transmits various types of information received from the information processing device according to appendix 10 to other information processing devices according to appendix 10,
When the display evaluation information is received by the relay unit, the extraction reference change information is generated when the display evaluation information does not satisfy the delay tolerance condition, and the generated extraction reference change information is included in the display evaluation information. A display evaluation information changing unit that causes the relay unit to transmit to the other information processing apparatus that is a transmission source of the sample coordinates relating to the display evaluation information;
A server with
(Appendix 12)
The information processing apparatus according to appendix 10,
The server according to appendix 11, and
Information processing system with
(Appendix 13)
When the coordinate information representing the coordinates on the display screen is acquired,
Sample coordinates are extracted from the acquired coordinate information based on a predetermined extraction criterion,
Sending the sample coordinates to another device;
Displaying handwritten information representing the locus of the sample coordinates;
Upon receiving the sample coordinates extracted in the other device,
Display handwritten information representing the locus of the received sample coordinates;
Generating display evaluation information representing an evaluation relating to display processing time required from reception of the sample coordinates to completion of display of handwritten information based on the sample coordinates;
Send the generated display evaluation information to the other device,
When receiving the display evaluation information generated in the other device,
An information processing method for changing the extraction criterion so as to reduce the extraction frequency of the sample coordinates when the received display evaluation information does not satisfy a predetermined delay allowable condition.
(Appendix 14)
Coordinate information acquisition processing for acquiring coordinate information representing coordinates on the display screen;
Sample coordinate extraction processing for extracting sample coordinates from the acquired coordinate information based on a predetermined extraction criterion;
Sample coordinate transmission processing for transmitting the sample coordinates to another device;
Handwritten information display processing for displaying handwritten information representing the locus of the sample coordinates;
Sample coordinate reception processing for receiving the sample coordinates extracted in the other device;
A received handwritten information display process for displaying handwritten information representing a locus of the received sample coordinates;
Display evaluation information generation processing for generating display evaluation information representing evaluation related to display processing time required from reception of the sample coordinates to completion of display of handwritten information based on the sample coordinates;
Display evaluation information transmission processing for transmitting the generated display evaluation information to the other device;
Display evaluation information reception processing for receiving the display evaluation information generated in the other device;
When the received display evaluation information does not satisfy a predetermined delay allowable condition, an extraction criterion changing process for changing the extraction criterion so as to reduce the extraction frequency of the sample coordinates;
Is a computer program that causes an information processing apparatus to execute.

DESCRIPTION OF SYMBOLS 1, 2 Information processing apparatus 3 Server 11 Coordinate information input part 12 Sample coordinate extraction part 13, 23 Sample coordinate transmission / reception part 14 Handwritten information display part 15 Display evaluation information generation part 16, 26 Display evaluation information transmission / reception part 17, 27 Change extraction criteria Unit 31 Relay unit 32 Display evaluation information changing unit 100, 200 Information processing system 1001, 3001 CPU
1002, 3002 RAM
1003, 3003 ROM
1004, 3004 Storage device 1005, 3005 Network interface 1006 Display device 1007 Input device

Claims (10)

A coordinate information input unit for inputting coordinate information representing coordinates on the display screen;
A sample coordinate extraction unit that extracts sample coordinates satisfying a predetermined extraction criterion from the coordinate information;
A sample coordinate transmission / reception unit for transmitting / receiving the sample coordinates to / from another information processing apparatus;
A handwritten information display unit for displaying handwritten information representing the locus of the sample coordinates in the own apparatus and the locus of the sample coordinates in the other information processing apparatus;
A display evaluation information generating unit that generates display evaluation information representing an evaluation related to display processing time required from completion of display of handwritten information based on the sample coordinates after receiving the sample coordinates from the other information processing apparatus;
A display evaluation information transmitting / receiving unit that transmits and receives the display evaluation information to and from the other information processing apparatus;
An extraction criterion changing unit that changes the extraction criterion so as to reduce the sampling frequency of the sample coordinates in the sample coordinate extracting unit when the display evaluation information received from the other information processing apparatus does not satisfy a predetermined delay allowable condition. When,
An information processing apparatus comprising: When the distance between the coordinate information input to the coordinate information input unit and the previously extracted sample coordinates is equal to or greater than a threshold, the sample coordinate extraction unit extracts the coordinate information as sample coordinates,
The information processing apparatus according to claim 1, wherein the extraction criterion changing unit changes the distance threshold value more largely when the display evaluation information received from the other information processing apparatus does not satisfy the delay permission condition. The sample coordinate extraction unit is smaller than an angle formed by the straight line that passes through the coordinate information input to the coordinate information input unit and the previously extracted sample coordinates, and the straight line that passes through the previously extracted sample coordinates and the sample coordinates extracted the last time. If the calculated angle is equal to or greater than a threshold, the coordinate information is extracted as sample coordinates,
The said extraction reference | standard change part changes the threshold value of the said angle more largely, when the said display evaluation information received from the said other information processing apparatus does not satisfy | fill the said delay permission conditions. Information processing device. The display evaluation information generation unit is configured to reduce the sample coordinate extraction frequency in the other information processing apparatus when the display evaluation information in the own apparatus does not satisfy the delay allowable condition. The extraction criteria change information representing the content to change the extraction criteria is generated in the display evaluation information,
The information according to any one of claims 1 to 3, wherein the extraction criterion changing unit changes the extraction criterion in accordance with extraction criterion changing information included in display evaluation information received from the other information processing apparatus. Processing equipment. A plurality of information processing devices according to any one of claims 1 to 4,
The display evaluation information transmission / reception unit of each information processing device transmits display evaluation information related to the sample coordinates received by the sample coordinate transmission / reception unit to the information processing device that is the transmission source of the sample coordinates,
The extraction criterion changing unit is configured to change the extraction criterion based on display evaluation information generated with respect to the sample coordinates in the information processing apparatus to which the sample coordinates transmitted by the sample coordinate transmitting / receiving unit are transmitted. . The sample coordinate transmission / reception unit performs transmission / reception of the sample coordinates with the other information processing apparatus via a server,
The information processing apparatus according to any one of claims 1 to 3, wherein the display evaluation information transmission / reception unit transmits and receives the sample coordinates to and from the other information processing apparatus via the server. A relay unit that transmits various types of information received from the information processing device according to claim 6 to another information processing device according to claim 6;
When the display evaluation information is received by the relay unit, the extraction reference change information is generated when the display evaluation information does not satisfy the delay tolerance condition, and the generated extraction reference change information is included in the display evaluation information. A display evaluation information changing unit that causes the relay unit to transmit to the other information processing apparatus that is a transmission source of the sample coordinates relating to the display evaluation information;
A server with An information processing apparatus according to claim 6;
A server according to claim 7;
Information processing system with When the coordinate information representing the coordinates on the display screen is acquired,
Sample coordinates are extracted from the acquired coordinate information based on a predetermined extraction criterion,
Sending the sample coordinates to another device;
Displaying handwritten information representing the locus of the sample coordinates;
Upon receiving the sample coordinates extracted in the other device,
Display handwritten information representing the locus of the received sample coordinates;
Generating display evaluation information representing an evaluation relating to display processing time required from reception of the sample coordinates to completion of display of handwritten information based on the sample coordinates;
Send the generated display evaluation information to the other device,
When receiving the display evaluation information generated in the other device,
An information processing method for changing the extraction criterion so as to reduce the extraction frequency of the sample coordinates when the received display evaluation information does not satisfy a predetermined delay allowable condition. Coordinate information acquisition processing for acquiring coordinate information representing coordinates on the display screen;
Sample coordinate extraction processing for extracting sample coordinates from the acquired coordinate information based on a predetermined extraction criterion;
Sample coordinate transmission processing for transmitting the sample coordinates to another device;
Handwritten information display processing for displaying handwritten information representing the locus of the sample coordinates;
Sample coordinate reception processing for receiving the sample coordinates extracted in the other device;
A received handwritten information display process for displaying handwritten information representing a locus of the received sample coordinates;
Display evaluation information generation processing for generating display evaluation information representing evaluation related to display processing time required from reception of the sample coordinates to completion of display of handwritten information based on the sample coordinates;
Display evaluation information transmission processing for transmitting the generated display evaluation information to the other device;
Display evaluation information reception processing for receiving the display evaluation information generated in the other device;
When the received display evaluation information does not satisfy a predetermined delay allowable condition, an extraction criterion changing process for changing the extraction criterion so as to reduce the extraction frequency of the sample coordinates;
Is a computer program that causes an information processing apparatus to execute.

Images