JP2012078974A - Electronic board system, coordinate point correcting device, coordinate point correcting method, and program - Google Patents

Abstract

In an electronic board system in which a mounting position of a pair of optical sensor units is arranged on the inner side of both left and right positions of a detection surface, when an input object is positioned outside of the pair of optical sensor units, the detection coordinates are shifted. Is less likely to occur.
A correction according to the size of the detected input object in the longitudinal direction of the detection surface regardless of whether the input object is positioned inside or outside the mounting position of the pair of optical sensor units. The initial detected coordinates are corrected by the amount.
[Selection] Figure 8

Description

  The present invention relates to an apparatus and method for correcting detected coordinates in an electronic board system, an electronic board system that implements the function, and a program.

  Currently, attention is being focused on electronic board systems. The electronic board system can use a finger or a dedicated electronic pen for coordinate input, draw characters, figures and other objects on the screen, or accept operations on image objects. For example, commands such as changing the color and thickness of a line to be drawn, issuing an event, enlarging / reducing an object, and deleting an object can be executed.

  The electronic board system has a basic configuration including a coordinate detection device, a display device, and an image generation device. The coordinate detection device is a system that detects the position of an input object, and various detection methods have been proposed. For example, an infrared method (optical method), an electromagnetic induction method, an ultrasonic method, and the like have been proposed.

  FIG. 1 shows a conceptual configuration of a coordinate detection apparatus that can acquire the coordinates of a plurality of points and the size of the input object using the shadow of the input object. The electronic boards 101 and 151 shown in FIGS. 1A and 1B correspond to infrared coordinate detection devices.

  The electronic board 101 includes a retroreflective reflective tape 103 disposed so as to surround the left side, the right side, and the lower side of the detection surface 102, and a position detection device 104 disposed above the detection surface 102. The The position detection device 104 includes a pair of left and right sensor units 104A and 104B, and a calculation unit 104C that calculates the coordinate position of the input object according to the principle of triangulation. Incidentally, the sensor units 104 </ b> A and 104 </ b> B include an infrared light source that scans infrared rays having a predetermined radiation angle along the detection surface 102, and an image sensor that captures an infrared image retroreflected by the reflective tape 103.

  However, in the case of the electronic board 101 in which the sensor units 104A and 104B are arranged at the left and right ends of the detection surface 102, distortion is likely to occur due to the long casing length, and the positional deviation between the image sensors is likely to increase due to the distortion. . As a result, blind spots are likely to occur in the image sensor. For this reason, the coordinates and the size of the object may not be acquired correctly.

  On the other hand, in the case of the electronic board 151 in which the sensor units 104A and 104B are arranged closer to the center in the horizontal direction of the detection surface 102, the case is less likely to be distorted due to the shorter case length. The positional deviation between the sensors can be small. As a result, the occurrence of blind spots can be reduced. For this reason, the electronic board 151 is excellent in correctly acquiring the coordinates and the size of the object.

  By the way, in the infrared method in which an image sensor detects a shadow generated by shielding an infrared ray from an input object, a period from when the fingertip is detected to when the finger is pressed against the finger is pressed against the detection surface 102. The size (thickness) of the detected input object changes.

  Here, the conventional apparatus calculates the center position of the detected object size (thickness) as detection coordinates. For this reason, the detected coordinates may be deviated from the fingertip position intended by the user, making it difficult to press the buttons on the operation screen. Also, when a command such as enlargement / reduction or rotation is executed, the thickness of the shadow may change, and enlargement / reduction or rotation may occur to an unintended place. Thus, the conventional apparatus is equipped with a detection coordinate correction function.

  A conventionally used correction function of detected coordinates will be described with reference to FIG. 2A and 2B correspond to FIGS. 1A and 1B, respectively. In the case of FIG. 2, the detected coordinates are corrected at the intersection position of a pair of infrared rays. For example, as shown in FIG. 2A, in the detection region between the sensor units 104A and 104B, only the coordinates in the vertical direction are to be corrected. Even in the case of the electronic board 151, the same result is obtained when the input object is located between the mounting positions of the sensor units 104A and 104B.

  However, as shown in FIG. 2B, in the case of the electronic board 151, the input object may be located outside the mounting position of the sensor units 104A and 104B. In this case, if the detected coordinates are corrected at the intersection of the pair of infrared rays, as shown in the figure, a correction component is generated not only in the vertical direction of the detection surface but also in the horizontal direction. That is, the coordinate point is corrected in the oblique direction of the detection surface.

  However, this correction direction is generally different from the intuitive operation direction of the user. In addition, the correction amount with respect to the initial detected coordinates also increases. For this reason, it becomes difficult to operate buttons and the like through the detection surface 102.

  Therefore, in the present invention, an electronic board system in which a pair of optical sensor units are arranged inside the left and right end positions of the detection surface, and the electronic board system detects the coordinates and size of the input object through each sensor output. It is an object of the present invention to provide an electronic board system in which even when an input object is located outside the mounting position of an optical sensor unit, a positional shift is unlikely to occur between a detection coordinate by the system and a user operation position. .

  As a result of intensive studies on the technical problem, the present inventor has invented a coordinate point correction technique suitable for an electronic board system in which the mounting positions of the pair of optical sensor units are arranged inside the left and right end positions of the detection surface. did. Specifically, it provides a function of correcting the input coordinates calculated as the center position of the input object in the vertical direction of the detection surface by a correction amount determined according to the size of the detected input object.

  According to the present invention, whether the input object is positioned inside or outside the mounting position of the pair of optical sensor units, depending on the size of the detected input object in the vertical direction of the detection surface. The initial detected coordinates can be corrected by the correction amount. As described above, the correction direction is limited only to the vertical direction, and the correction amount is determined according to the size of the input object, so that the corrected coordinates can be brought close to the operation position of the user.

The figure explaining the detection principle of the input object by the electronic board which can detect multiple points simultaneously. The figure explaining the correction | amendment operation | movement of the input point by a conventional system. The figure explaining the structure of the electronic board system which concerns on an example. The figure explaining the input state which can be detected. The figure which shows the data structure of the coordinate data output from a coordinate detection apparatus. The figure explaining the shift | offset | difference of the input coordinate at the time of operating with the belly of a finger | toe when a fingertip is detected (conventional example). The figure explaining the function structure of a coordinate point correction apparatus. The flowchart explaining the processing operation of a coordinate point correction program. The figure explaining the correction | amendment operation | movement of the input point by a form example.

  Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In addition, the form examples described below are used exclusively for explaining the invention, and various forms are conceivable depending on combinations with existing technologies when mounted on actual products. In the following description, the coordinate point correction function according to the present invention is described as being realized through a program executed on a computer. However, part or all of the program can be realized through hardware. .

(Outline of electronic board system)
FIG. 3 illustrates a configuration example of the electronic board system 301 according to the configuration example. The electronic board system 301 is basically composed of a coordinate detection device, a display device, and an image generation device. The coordinate detection device includes a position detection device 303 and a reflection plate 304.

  The position detection device 303 includes a pair of left and right sensor units and a calculation unit (not shown). The pair of left and right sensor units are arranged near the center of the detection surface 305 in the horizontal direction. In the case of this embodiment, the infrared scan range by the infrared light source is approximately 180 degrees. Similarly, the image sensor in the sensor unit has an angular range of approximately 180 degrees as the light receiving range. In the drawing, each sensor unit has an imaging range on the left side, the lower side, and the right side of the detection surface 305.

  The calculation unit calculates each detection coordinate of one or a plurality of input objects 302 in contact with the detection surface 305 based on the position of the shadow included in the captured image output from the pair of left and right sensor units. The calculation unit according to this embodiment also has a function of determining the size and number of detected input objects 302. These pieces of information are output as input data for the input object. In the case of this embodiment, it is assumed that the origin of coordinates is set at the upper left corner of the detection surface 305, and the x coordinate increases toward the right side and the y coordinate increases toward the bottom side.

  The reflection plate 304 has a structure in which a reflection tape on which minute optical elements that retroreflect infrared rays in the incident direction are arranged is attached to a frame. Accordingly, when no object is present on the infrared light path, the infrared light incident on the reflector 304 is reflected in the incident direction and is imaged by the image sensor. On the other hand, when the input object 302 (the pen in the figure) is positioned on the infrared light path, the infrared light is shielded by the input object 302 and captured as a shadow by the image sensor. In addition, the reflecting plate 304 which comprises each edge | side may be fixed to the single frame, and each may be divided | segmented and fixed to the independent frame.

  In the case of this embodiment, a projector 310 is used as the display device. The display device may be a PDP, a liquid crystal display, or other flat panel display.

  The image generation apparatus includes a control computer 306, a keyboard 307 and a display device 308 that are peripheral devices thereof. The control computer 306 has the same function as a general-purpose personal computer. In the internal memory of the control computer 306, input data input from the position detection device 303 at a constant sampling rate is sequentially stored. In addition, the internal memory stores a display content control program 309 that recognizes or processes a character object or an image object based on input data, or generates an operation screen from these objects. As a part of the display content control program 309, a coordinate point correction program for correcting the detected coordinates of the input object 302 is also stored.

(Examples of input modes that can be detected)
FIG. 4 shows input modes that can be detected by the control unit of the position detection device 303 according to the embodiment. The position detection device 303 can detect the three input modes shown in FIGS. That is, a one-point input state corresponding to a case where only one finger is brought into contact with the detection surface 305, a two-point input state corresponding to a case where two fingers are simultaneously brought into contact with the detection surface 305, and the entire palm as a detection surface It is possible to detect the palm input state corresponding to the contact with the touch panel.

  The determination of these input states can be changed between each other depending on the contact state of the hand or finger with respect to the detection surface 305. These transition determinations are executed by an input state determination program installed in the position detection device 303. For example, when an independent second coordinate is detected in a state where it is determined as a one-point input state, the current input state is determined as a two-point input state. For example, even when it is determined that the input state is the one-point input state or the two-point input state, if the size of the input object exceeds a predetermined size, the current input state is determined as the palm input state.

  In this way, when individual operation events are assigned to a plurality of identifiable input states, the display content control program 309 is instructed to issue a specific operation event in accordance with the switching of the input state by the user. can do. For example, various events can be instructed to the display content control program 309 such as drawing a line in the one-point input state, erasing the line in the two-point input state, and scrolling the screen in the palm input state.

(Example of packet data structure)
FIG. 5 shows a data structure example of input data notified from the position detection device 303 to the control computer 306. FIG. 5A shows an example format of packet data, and FIG. 5B shows a specific example of packet data.

  The input data 501 for one frame is an example of a data structure used when n (n is 2 or more) objects are detected simultaneously. In this specification, one frame corresponds to the minimum unit period (cycle) in which the detection process of the input object 302 is completed for the entire range of the detection surface 305.

  The input data 501 includes a time 502 when the input object 302 (for example, a pen or a finger) is detected, the number of detected objects 503, coordinate information 504 corresponding to each detected input object 302, and size information 505. Treated as input data 501.

  (B1) in FIG. 5 shows input data 506 output when no input object 302 exists on the detection surface 305. In this case, data composed of the detection time “T1” when detection is performed and the number of detected objects “0” is generated.

  FIG. 5B2 shows input data 507 that is output when only one finger, pen, or other input object 302 exists on the detection surface 305. In this case, data including a detection time “T2” when detection is performed, the number of detected objects “1”, corresponding coordinate information 504, and size information 505 is generated.

  In the case of this embodiment, the size information 505 of the detected object indicates the size of the shadow detected by the sensor unit. In addition, the center coordinate of the object detected as a shadow is used for the detected coordinate information.

(Example of input deviation due to input object size change)
FIG. 6 shows an example of input deviation when the input data 501 (506, 507) input from the position detection device 303 is used as it is. The upper part of FIG. 6 is a diagram that emphasizes the change in the contact state between the detection surface 305 and the fingertip after the start of input. The lower part of FIG. 6 is a diagram showing the contents of the display screen at the time corresponding to the upper part.

  FIG. 6 shows an example in which an arrow cursor is displayed at the detected coordinates of the fingertip. As shown in FIG. 6, when the fingertip is pressed against the detection surface 305, the size of the input object detected by the position detection device 303 changes. That is, the contact area indicated by shading in the upper part of FIG. 6 changes from a small area to a large area. This is because the contact with only the fingertip at the start of input becomes the contact with the belly of the finger at the end of input.

  As described above, in this case, the position detection device 303 outputs the input data 501 whose coordinate value is the center position of the range (detection object size) where the input object 302 (fingertip) blocks infrared rays. That is, the coordinate information 504 of the input data 501 shifts downward from the coordinates at the start of input as the size of the detected object increases. As a result, as shown in the lower right part of FIG. 6, the arrow cursor deviates from the button position on the screen. This makes it difficult to identify that a button press event has occurred in the display content control program 309.

(Contents of coordinate point correction function)
Hereinafter, the configuration of the coordinate point correction apparatus realized through execution of the coordinate point correction program by the control computer 306 will be described. As described above, the coordinate point correction program constitutes a part of the display content control program 309.

  FIG. 7 shows a functional configuration example of the coordinate point correction apparatus 3091. The coordinate point correction apparatus 3091 includes an input information analysis unit 701, an execution function control unit 702, and an input information storage unit 703.

  The input information analysis unit 701 inputs the input data 501 from the position detection device 303, and decomposes the input data 501 into a detection time 502, a detected object number 503, coordinate information 504, and size information 505.

  The execution function control unit 702 executes the basic operation of the display content control program 309 based on the input information given from the previous stage and the history information of the input information stored in the input information storage unit 703. As part of this operation, a process for calculating the correction coordinates of the input object is executed. The correction coordinate calculation processing is a processing function proposed by the present inventor. Input information obtained by replacing the coordinate information 504 of the input object given from the input information analysis unit 701 with the corrected coordinates is stored in the input information storage unit 703 as the latest history information.

(Processing procedure of coordinate point correction program)
FIG. 8 shows a processing procedure example of the coordinate point correction program according to the embodiment. The computer as the execution function control unit 702 constantly monitors whether the input start is detected. Specifically, the computer determines whether or not the number of detected objects 503 has changed from “0” to “1” or more (step 801). The computer repeats the determination operation while a negative result is obtained.

  When it is detected that the number of detected objects 503 has changed from “0” to “1” or more, the computer extracts the number of detected objects 503, coordinate information 504, and size information 505 as input information (step 802).

  Next, after initializing the number of inputs to “0”, the computer adds “1” to the current number of inputs (steps 803 and 804).

  Next, the computer determines whether or not the input object size is larger than the threshold value 1 (first threshold value) for the first input object (step 805). Here, the first input object corresponds to the detection object 1 recorded at the head of the packet format shown in FIG.

  The threshold value 1 here is assumed to be a palm input state determination threshold value. Therefore, when the input object size is larger than the threshold value 1, the computer determines that the input is a palm and ends the process without performing the coordinate point correction process. Accordingly, the coordinate information 504 of the input data 501 is stored in the input information storage unit 703 as it is.

  On the other hand, if the input object size is smaller than the threshold value 1, the computer determines whether the input object size is smaller than the threshold value 2 (second threshold value) (806). The threshold value 2 here corresponds to an execution margin for coordinate point correction. For example, as shown in the left diagram of FIG. 6, when the input object size is small, the coordinate deviation can be ignored. The value of the threshold 2 may be an initial set value, may be individually set by a service staff, or may be adjusted according to the user's preference. It is preferable that the adjustment by the user can be executed through the GUI screen.

  When the input object size is larger than the threshold 2, the computer determines that the coordinate information 504 of the input data 501 includes a coordinate shift. That is, the computer executes a coordinate point correction process. At this time, the computer uses the input object size of the input data 501 and issues a correction event for subtracting half (radius) of the input object size from the y coordinate of the coordinate information 504 (step 807).

  Here, the reason why the correction event is issued only for the y coordinate is that the input operation by the fingertip of the user is basically executed in the vertical direction (y direction). Therefore, correction is performed only in the vertical direction. In addition, half of the input object size (radius) is used as the correction amount because, in the input data 501 output from the position detection device 303 to the control computer 306, the coordinate information 504 of the input object is the detected input object size. This is because it is given as the center position. Thus, the correction amount is determined by the input object size. Therefore, the correction amount is the same regardless of where the input object 302 is located on the detection surface, that is, between the pair of sensor units 104A and 104B or outside.

  FIG. 9 shows a correction image when the correction function according to the embodiment is applied. In the position detection device 104 used in this embodiment, the attachment positions of the pair of left and right sensor units 104 </ b> A and 104 </ b> B are located inside the left and right end positions of the detection surface 102. 9A and 9B, the electronic board 151 is drawn in which the horizontal length of the position detection device 104 is shorter than the horizontal length of the detection surface 102.

  9A shows a case where the input object is located between the pair of left and right sensor units 104A and 104B, and FIG. 9B shows that the input object is a pair of left and right sensor units 104A and 104B. The case where it is located outside is shown. In any case, it can be seen that the corrected input point (corrected input point) is corrected only in the vertical direction (y direction) with respect to the original detected input point. For this reason, even when the user of the electronic board 151 presses the fingertip against the detection surface 102, the downward movement of the coordinate point due to the pressing can be canceled.

  If the input object size is smaller than the threshold value 2, the computer determines that there is no significant shift in the input coordinates, and proceeds to the next processing step without executing the correction processing described above.

  Next, the computer determines whether or not the number of input objects is “2” (step 808). If a negative result is obtained, the computer determines that the number of processed inputs and the number of input objects are the same, and ends the process.

  If the number of input objects is “2”, the computer determines whether or not the current number of inputs is “2” (step 809). This determination is used to determine whether correction processing has already been completed for all input objects. Here, if a negative result is obtained, the computer returns to step 804 to update the number of inputs from “1” to “2” in order to execute a correction process on the second input object.

  Thereafter, the computer executes detection coordinate correction processing for the second input object. If an affirmative result is obtained in step 809, the computer determines that the correction processing of the detected coordinates has been completed for the second input object, and the processing operation is terminated.

(Summary)
As described above, as a detection coordinate correction technique when the horizontal length of the position detection device 104 is shorter than the horizontal length of the detection surface 102, the detection coordinate is corrected upward by half of the input object size. Adopt processing method. Thereby, even when the input object 302 is located at any location on the detection surface 102, the corrected coordinate value can be determined in the vicinity of the operation position of the user. In particular, even when the fingertip is positioned outside the pair of sensor units, the correction amount and the correction direction can be matched with the case where the fingertip is positioned inside the pair of sensor units.

  In addition, since the correction amount is set to half of the input object size, the movement amount of the center position accompanying the pressing of the fingertip against the detection surface 102 can be almost canceled. The detected coordinates can be corrected near the area where the fingertip first touched.

(Other examples)
In the case of FIG. 8, the case where the number of input objects that can be detected simultaneously is “2” has been described, but the number of input objects that can be detected simultaneously may be three or more. In this case, the step of determining whether or not the number of input objects matches the number of inputs is arranged in place of step 808 and step 809, and while a negative result is obtained, the process returns to step 804 to obtain a positive result. In such a case, the process may be terminated.

  In the case of the above-described embodiment, half of the input object size is subtracted from the detected coordinate because the value of the y coordinate increases toward the lower side of the detection surface. Therefore, in the case of other coordinate systems, other calculation processes may be applied as calculation contents for correcting coordinates above the detection surface. For example, when the coordinate value increases toward the upper side of the detection surface, the correction amount may be added to the detection coordinate.

  In the case of the above-described embodiment, the correction amount is set to half of the input object size. However, if the correction amount is determined according to the input object size, the amount is not necessarily half of the input object size. For example, 1/3 may be sufficient.

  In the case of the above-described embodiment, the coordinate value is corrected only when the input object size is greater than or equal to the threshold value 2, but the coordinate value is always used unless a palm input state is determined (as long as a negative result is obtained in step 805). May be corrected.

  In the case of the above-described embodiment, it has been described that the sensor units 104A and 104B scan infrared rays in a range of approximately 180 degrees. However, a plurality of light sources may be arranged so that the respective infrared irradiation ranges are different so that the entire irradiation range can illuminate a range of approximately 180 degrees.

DESCRIPTION OF SYMBOLS 101 Electronic board 102 Detection surface 103 Reflective tape 104 Position detection apparatus 104A Sensor unit 104B Sensor unit 104C Calculation unit 151 Electronic board 301 Electronic board system 302 Input object 303 Position detection apparatus 304 Reflection plate 305 Detection surface 306 Control computer 309 Display content control Program 310 Projector 701 Input information analysis unit 702 Execution function control unit 703 Input information storage unit 3091 Coordinate point correction device

Claims (4)

A display device for displaying an image in an overlapping area with the detection surface;
A recursive reflector that is arranged so as to surround the right side, the left side, and the lower side of the detection surface, and each reflection surface is arranged perpendicular to the detection surface;
A pair of optical sensor units attached to the inside of the left and right end positions of the detection surface;
A calculation unit that calculates the input coordinates and size of the input object with respect to the detection surface based on each sensor output output from the pair of optical sensor units;
An electronic board system, comprising: a coordinate point correction device that corrects the input coordinates calculated as the center position of the input object in a vertical direction of the detection surface by a correction amount determined according to the size of the input object. Coordinate point correction that constitutes an electronic board system together with a pair of optical sensor units attached inside the left and right end positions of the detection surface and a calculation unit that calculates the input coordinates and size of the input object with respect to the detection surface based on each sensor output In the device
A coordinate point correction apparatus, wherein the input coordinates calculated as the center position of the input object are corrected in the vertical direction of the detection surface by a correction amount determined according to the size of the input object. Coordinates used in the electronic board system, together with a pair of optical sensor units mounted inside the left and right end positions of the detection surface, and a calculation unit that calculates the input coordinates and size of the input object with respect to the detection surface based on each sensor output In the point correction method,
Processing for inputting the input coordinates calculated as the center position of the input object from the calculation unit;
A coordinate point correction method comprising: correcting the input coordinates in the vertical direction of the detection surface by a correction amount determined according to the size of the input object. A computer that constitutes an electronic board system together with a pair of optical sensor units attached inside the left and right end positions of the detection surface and a calculation unit that calculates the input coordinates and size of the input object with respect to the detection surface based on each sensor output,
Processing for inputting the input coordinates calculated as the center position of the input object from the calculation unit;
A program for executing a process of correcting the input coordinates in the vertical direction of the detection surface by a correction amount determined according to the size of the input object.

Images