JP2013232034A - Input device and input method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide "an input device and an input method" capable of effectively suppressing incorrect detection by a touch panel by cooperation with an easy imaging technique and image processing technique.SOLUTION: An input device includes: imaging means 16 for photographing a predetermined imaging area facing a screen; first determination means 30 for determining whether or not an object equal to or larger than a predetermined size is included in an image photographed by the imaging means 16 on the basis of the photographed image; and control means 32 for controlling operation of a touch panel 1 for not detecting, when a foreign substance intrudes on the screen, an intrusion position of the foreign substance incorrectly as an operation position according to a determination result by the first determination means 30.

Description

  The present invention relates to an input device and an input method, and more particularly to an input device and an input method suitable for an input operation using a touch panel.

  Conventionally, resistive touch panels and capacitive touch panels have been the mainstream for touch panels placed on the front of LCDs (Liquid Crystal Displays). Recently, however, optical touch panels have also been newly introduced. Because the operability has been greatly improved by the optical system, needs are increasing.

  Here, FIG. 7 schematically shows a cross section in the case where such an optical touch panel 1 is cut along a plane perpendicular to the Y direction (the vertical direction in the figure). FIG. 8 schematically shows a cross section when the touch panel 1 is cut along a plane perpendicular to the X direction (lateral direction in FIG. 7).

  As shown in FIGS. 7 and 8, the touch panel 1 is disposed in parallel and opposite to the LCD 2 on the back side (anti-viewing side) of the LCD 2 having a rectangular planar shape with a predetermined distance from the LCD 2. The PWB (Printed Wiring Board) 3 has a rectangular planar shape.

  Further, as shown in FIG. 7, a plurality of Y coordinate detection IR transmissions comprising IR (infrared) -LEDs or the like are positioned near one end (left end) in the X direction (horizontal direction in the figure) on the upper surface of the PWB 3. The portions 4y are aligned and arranged at equal intervals in the Y direction (the direction perpendicular to the paper surface of the figure). The plurality of IR transmission units 4y for Y coordinate detection emit (irradiate) infrared rays (see the broken line portion) toward the outside in the X direction (left side in FIG. 7).

  Further, as shown in FIG. 7, a plurality of Y coordinate detection IR receivers 5y made of photodiodes or the like are arranged at equal intervals in the Y direction near the other end (right end) in the X direction on the upper surface of the PWB 3. Are arranged and arranged. However, a larger number (one more) of Y coordinate detection IR receivers 5y are arranged than the Y coordinate detection IR transmitters 4y. The plurality of IR receivers 5y for Y coordinate detection have a light receiving surface facing outward in the X direction (rightward in FIG. 7), and correspond to each IR receiver 5y for Y coordinate detection. Infrared rays from the Y coordinate detecting IR transmitter 4y are incident from the outside in the X direction. Such an infrared optical path is formed by a light guide plate 7 described later.

  Furthermore, as shown in FIG. 8, a plurality of X-coordinate detection IR transmitters 4x are arranged in the X direction (same as the same) in the vicinity of one end (left end) in the Y direction (horizontal direction in the figure) on the upper surface of the PWB 3. They are arranged at regular intervals in the direction perpendicular to the drawing. The plurality of X coordinate detection IR transmitters 4x emit infrared rays outward in the Y direction (left side in FIG. 8).

  Further, as shown in FIG. 8, a plurality of X coordinate detection IR receiving units 5x are arranged at equal intervals in the X direction near the other end (right end) in the Y direction on the upper surface of the PWB 3. Has been. However, a larger number (one more) of X-coordinate detection IR receivers 5x are arranged than the X-coordinate detection IR transmitter 4x. The plurality of X coordinate detection IR receiving units 5x have light receiving surfaces facing outward in the Y direction (rightward in FIG. 8), and correspond to each X coordinate detection IR receiving unit 5x. Infrared rays from the X-coordinate detection IR transmitter 4x are incident from the outside in the Y direction. Such an infrared optical path is formed by a light guide plate 7 described later.

  Further, as shown in FIGS. 7 to 9, a light guide plate 7 having a frame shape in a plan view is arranged on the outside (outer periphery) of the LCD 2 and the PWB 3.

  As shown in FIG. 7, the light guide plate 7 corresponds to each of the infrared rays emitted (transmitted) from the Y coordinate detection IR transmitters 4y after traveling on the surface (near) of the LCD 2 in the X direction. Light is guided so as to be received (received) by the Y coordinate detection IR receiver 5y. For such infrared light guide for Y-coordinate detection, a total of four reflections by all four inclined reflecting surfaces 7y formed on the upper and lower end faces of the light guide plate 7 in the X direction (all Reflection may be used).

  Further, as shown in FIG. 8, the light guide plate 7 transmits each infrared ray emitted from each X coordinate detection IR transmission unit 4 x on the surface of the LCD 2 in the Y direction and then corresponds to each X coordinate detection IR. Light is guided so as to be received by the receiver 5x. For such infrared light guide for X coordinate detection, a total of four reflections (total of four reflection surfaces 7x formed on the upper and lower end surfaces of the light guide plate 7 on the upper and lower end surfaces in the Y direction) Reflection may be used). However, the number of reflection surfaces to be arranged on the light guide plate 7 and the number of reflections vary depending on the irradiation direction of the transmission unit 4 and the light reception direction of the reception unit 5.

  With such a configuration, as shown in FIG. 9, a radiation grid-like infrared optical path used for coordinate detection is formed on the surface of the LCD 2.

  When the user touches the surface of the LCD 2 with his / her finger, the infrared ray corresponding to the touched position (that is, the operation position) is shielded by the finger. The operation position can be determined based on the set of the unit 5y and the X coordinate detection IR receiving unit 5x. Here, in the conventional optical touch panel, since the transmission / reception has a one-to-one relationship, the position detection accuracy is low. However, in the above configuration, the transmission / reception has a one-to-multiple relationship, so that high-precision position detection is possible. It can be performed. Such technology is realized by neonode.

  Note that the infrared emission by the IR transmitters 4y and 4x and the coordinate detection of the operation position are performed, for example, according to a time chart as shown in FIG. In FIG. 10, 30 msec is allocated to one scan, and among these, infrared emission is performed by applying a drive pulse to the IR transmitters 4y and 4x in the first 200 μsec, and in the remaining period, the light shielding analysis and Coordinate detection is performed.

JP 2006-343919 A

  Conventionally, a touch panel has an advantage that an intuitive operation can be performed on an operation target device. On the other hand, when a foreign object adheres to the operation surface, the position where the foreign object adheres is erroneously set as an operation position. Detection has been pointed out as a problem (see, for example, Patent Document 1).

  In particular, as in the optical touch panel 1 described above, in a configuration that does not require a push-down operation in which electromagnetic waves (infrared rays) for coordinate detection flow on the operation surface, and in a configuration with high position detection accuracy, Even if such a small insect entered the operation surface, false detection had occurred, and the problem became even more serious. By the way, when the present inventor actually performed an evaluation by simulating an insect using a prototype, a foreign object having a diameter of 2 mm or more is erroneously detected, that is, a heel leg is not detected although a heel leg is not detected. As a result.

  In this regard, Patent Document 1 proposes a technique in which a surface acoustic wave is caused to flow below the operation surface and the surface acoustic wave is not absorbed (touch panel operation is not detected) unless it is slightly depressed. Has been.

  The technique described in Patent Document 1 is a self-contained problem of erroneous detection in the touch panel by the configuration itself of the touch panel, but prevents the surface acoustic wave that should flow on the operation surface from flowing on the operation surface. This involves a major change in the basic structure of the touch panel.

  On the other hand, the present inventor solves the problem of erroneous detection of the touch panel by utilizing the basic structure of the current touch panel (in other words, the existing technology) and linking with a simple imaging technology / image processing technology. As much research as possible was made and the present invention was made.

  That is, an object of the present invention is to provide an input device and an input method capable of effectively suppressing erroneous detection by a touch panel by cooperation with a simple imaging technique and image processing technique.

  In order to achieve the above-described object, an input device according to the present invention includes a touch panel having an operation position detection unit that detects an operation position on a screen of a display unit in a main body device as coordinates, and the main body device is provided with the touch panel. An input device capable of performing an input operation according to the operation position detected by the operation position detection unit, and an imaging unit that images a predetermined imaging area facing the screen, and the imaging A first determination unit that determines whether or not an object having a size larger than a predetermined size that is regarded as an operation object for touch panel input is included in the captured image based on a captured image of the unit; According to the determination result of the first determination means, the tapping for not erroneously detecting the entry position of the foreign object when the foreign object enters the screen as the operation position. It is characterized in that a control means for controlling the operation of the panel.

  Further, the input method according to the present invention is an input for detecting an operation position on the screen of the display unit in the main body device as coordinates using a touch panel and performing an input operation corresponding to the operation position on the main body device. The method is based on a first step of imaging a predetermined imaging area facing the screen and the captured image captured in the first step, and is regarded as an operation object for touch panel input in the captured image. A second step of determining whether or not an object having a size larger than a predetermined size is included, and the case where a foreign object enters the screen according to a determination result in the second step And a third step of controlling the operation of the touch panel so as not to erroneously detect the entry position of the foreign object as the operation position.

  According to the present invention, even when a small foreign object enters the screen, a relatively large object that can be regarded as an operation object for touch panel input is present in the captured image of the imaging region facing the screen. Based on whether it is detected or not, the touch panel operation can be controlled so that the intrusion position of a foreign object on the screen is not erroneously detected as the operation position, so erroneous detection is achieved through cooperation with simple imaging technology and image processing technology. Can be effectively suppressed.

  Furthermore, in the input device according to the present invention, the operation control of the touch panel may not be driven when the negative determination result is obtained by the first determination unit, or the operation of the touch panel is detected. Even so, the control may be such that the operation position detection means does not detect the operation position. Similarly, in the input method of the present invention, in the third step, when a negative determination result is obtained in the second step, the touch panel is not driven or an operation of the touch panel is detected. Even if it is, it may be a step of performing control not to detect the operation position.

  According to the present invention, for example, the operation of the touch panel is in an undetected stage, and an object having a size that is regarded as an operation object for touch panel input is not detected in the captured image. If it is clear that the touch panel operation is not performed, if the touch panel is not driven, the intrusion of the foreign object will not even be detected as an operation of the touch panel. It is possible to more effectively suppress the occurrence of power consumption, and further, it is possible to reduce power consumption and improve product life by preventing unnecessary driving of the touch panel. On the other hand, for example, after detecting an operation of the touch panel, even if it is confirmed that an object of a size that is regarded as an operation object for touch panel input is not detected in the captured image, the operation position is not detected. , False detection can be effectively suppressed.

  Furthermore, in the input device of the present invention, the operation control of the touch panel is a case where the touch panel is not driven, and the control is performed in response to a positive determination result obtained by the first determination unit. A second determination unit configured to determine whether or not the shape of an object having a size equal to or larger than the predetermined size has not changed for a predetermined time based on the captured image when the touch panel is driven by the unit; The control means may stop driving the touch panel when a positive determination result is obtained by the second determination means. Similarly, in the input method of the present invention, when the third step is a step of performing control without driving the touch panel, the touch panel according to the fact that a positive determination result is obtained in the second step. And after the touch panel is driven in the fourth step, whether or not the shape of the object having a size equal to or larger than the predetermined size has not changed for a predetermined time based on the captured image. And a sixth step of stopping driving of the touch panel when a positive determination result is obtained in the fifth step.

  According to the present invention as described above, after the touch panel is driven by detecting an object of a size that is regarded as an operation object for touch panel input in the captured image, a change in the shape of the detected object is observed for a predetermined time. If this is not the case, by stopping driving the touch panel, for example, it is possible to effectively suppress false detection when a foreign object enters while a user unfamiliar with touch panel handling is lost in touch panel input. .

  Further, in the input device according to the present invention, based on the captured image, a third determination unit that determines whether or not the captured image includes the shape of a predetermined operation object for non-contact operation, When a positive determination result is obtained by the third determination unit, a non-contact operation unit that inputs an operation signal corresponding to the shape of the operation object to the main body device may be provided. Similarly, in the input method of the present invention, based on the captured image, a seventh step of determining whether or not the captured image includes a shape of a predetermined operation object for non-contact operation, When a positive determination result is obtained in the seventh step, an eighth step of inputting an operation signal corresponding to the shape of the operation object to the main body device may be included.

  According to the present invention, since the configuration for non-contact operation can be utilized for suppressing erroneous detection of touch panel input, diversification / efficiency of operation input to the main unit and the number of parts can be reduced. It is possible to achieve both suppression and adapt to recent trends (needs) of in-vehicle devices that are incorporating gesture input.

  Furthermore, in the input device of the present invention, the operation object may include a user's hand.

  And according to such a structure, touch panel input and non-contact operation can be performed simply, and it can apply effectively also to input operation (for example, input operation to the vehicle equipment in a vehicle interior) in a narrow operation space. Can do.

  Furthermore, in the input device of the present invention, the touch panel may include an optical touch panel.

  According to such a configuration, even in an optical touch panel in which the problem of erroneous detection by the touch panel due to the intrusion of foreign matter becomes serious, satisfactory results can be achieved with respect to suppression of erroneous detection.

  ADVANTAGE OF THE INVENTION According to this invention, the misdetection by a touchscreen can be suppressed effectively by cooperation with simple imaging technology and image processing technology.

1 is a schematic diagram showing a first embodiment of an input device according to the present invention. 1 is a schematic configuration diagram showing a gesture input unit in the input device of FIG. The block diagram which shows the concrete structure of the input device of FIG. The flowchart which shows 1st Embodiment of the input method which concerns on this invention. The block diagram which shows 2nd Embodiment of the input device which concerns on this invention. The flowchart which shows 2nd Embodiment of the input method which concerns on this invention. First cross-sectional schematic diagram showing an optical touch panel Second cross-sectional schematic diagram showing the touch panel of FIG. The top view which shows the touch panel of FIG. Time chart showing operation of touch panel in FIG.

(First embodiment)
(Input device)
Hereinafter, a first embodiment of an input device according to the present invention will be described with reference to FIGS. 1 to 3.

  Note that portions having the same or similar basic configuration as those in the related art will be described using the same reference numerals.

  FIG. 1 is a schematic diagram showing an input device 10 according to the present embodiment. As shown in FIG. 1, the input device 10 includes a touch panel 1 mounted on a main body device 11 including an LCD 2 as an example of a display device, and a gesture input unit 12. The gesture input unit 12 is disposed outside the display area on the front surface of the main device 11. The main device 11 may be an in-vehicle device (head unit).

  Here, the touch panel 1 is an optical touch panel 1 similar to that shown in FIGS. 7 to 9, and is used for touch panel input to the main body device 11 using the user's hand as an operating object.

  On the other hand, the gesture input unit 12 is used for a non-contact operation (so-called gesture input) with respect to the main body device 11 using the user's hand as an operation object. “Non-contact” means that an input operation can be performed according to the shape and movement of the user's hand without touching the surface of the LCD 2. A specific configuration for this will be described later. In the in-vehicle device, when the driver's seat is on the right side (right handle), as shown in FIG. 1, the gesture input unit 12 may be arranged at the upper right end suitable for detecting the user's hand. However, the user's arm may be included in the operation object for the non-contact operation.

  Thus, in the configuration having both the touch panel 1 and the gesture input unit 12, what operation is shared between the touch panel input and the non-contact operation depends on the operation target application of the main body device 11. For example, frequently used rough operations (song skipping, channel change, etc.) can be performed in non-contact operation, and multiple operations and detailed operations (50-sound input, hierarchical menu selection, etc.) can only be touch panel input. It is good.

  Next, FIG. 2 is a schematic configuration diagram schematically illustrating an example of the appearance of the gesture input unit 12.

  As shown in FIG. 2, the gesture input unit 12 has an imaging camera 16 as an imaging means on which a lens 14 and a gesture sensor 15 are mounted. As the gesture sensor 15, for example, it is sufficient to use a solid-state imaging device having the number of pixels of about 64 × 64 pixels. The imaging camera 16 captures a predetermined imaging area in front of the screen of the display unit of the main unit 11 (that is, the display area on the surface of the LCD 2). The imaging area may be an area that can capture a user's hand that is assumed in a non-contact operation and touch panel input.

  In addition, as shown in FIG. 2, the gesture input unit 12 realizes basic processing for non-contact operation based on a captured image (video) of the imaging camera 16 and cooperation with touch panel input unique to the present invention. It has the processing apparatus 17 which performs the process for doing. The processing device 17 may be configured by a CPU, a ROM storing an execution program of the CPU, a RAM used for temporarily storing processing results of the CPU, and the like.

  Furthermore, as shown in FIG. 2, the gesture input unit 12 has an infrared irradiation LED 18. This infrared irradiation LED 18 irradiates infrared rays toward the front (the subject side of the imaging camera 16). Therefore, the imaging camera 16 can capture an image of the hand by infrared reflected light from the user's hand. Such a configuration is suitable for use at night in the passenger compartment.

  Furthermore, as shown in FIG. 2, the imaging camera 16, the processing device 17, and the infrared irradiation LED 18 are mounted on one circuit board 19 and unitized.

  Next, FIG. 3 is a block diagram showing a specific configuration of the input device 10.

  As shown in FIG. 3, the touch panel 1 has an IR drive circuit 21. The IR drive circuit 21 drives the IR transmitters 4y and 4x by applying drive pulses as shown in FIG. 10 to the IR transmitters 4y and 4x described above. By this driving, the IR transmitters 4y and 4x emit infrared rays for coordinate detection. The infrared rays are received by the IR receivers 5y and 5x via the screen of the LCD 2, as shown in FIGS.

  As shown in FIG. 3, the touch panel 1 includes a light shielding analysis unit 22. The light shielding analysis unit 22 receives the light reception results of the IR receiving units 5y and 5x after being converted into electrical signals (photoelectric conversion). And the light-shielding analysis part 22 detects operation of the touch panel 1 by detecting that there exists IR light-receiving part 5y, 5x by which light shielding was performed based on the received light reception result.

  Further, as shown in FIG. 3, the touch panel 1 includes a coordinate detection unit 23 as an operation position detection unit. When the operation of the touch panel 1 is detected by the light shielding analysis unit 22, the coordinate detection unit 23 calculates the coordinates corresponding to the IR light receiving units 5 y and 5 x that are shielded from light, thereby using the operation position of the touch panel 1 as a coordinate. It comes to detect. The coordinates may be detected with reference to a table in which the correspondence between the alignment numbers of the IR light receiving units 5y and 5x and the coordinates is described.

  Furthermore, as shown in FIG. 3, the touch panel 1 has a coordinate input unit 24. The coordinate input unit 24 inputs the coordinates detected by the coordinate detection unit 23 to the main body device 11.

  In this way, basic touch panel input is performed. In addition, you may comprise the light-shielding analysis part 22, the coordinate detection part 23, and the coordinate input part 24 by CPU, ROM, RAM, etc.

  On the other hand, as shown in FIG. 3, the processing device 17 of the gesture input unit 12 includes an image recognition unit 25. Data of the image captured by the imaging camera 16 is input to the image recognition unit 25 from the gesture sensor 15. The image recognition unit 25 performs image recognition based on the input captured image data.

  Specifically, as illustrated in FIG. 3, the image recognition unit 25 includes a third determination unit 26 as a third determination unit. The third determination unit 26 performs edge detection based on the captured image data to determine whether or not the captured image includes the shape of the user's hand as a predetermined non-contact operation object. And a known simple image recognition technique such as pattern matching. However, the determination by the third determination unit 26 may be performed after confirming that the operation of the touch panel is not detected by the light shielding analysis unit 22.

  As shown in FIG. 3, the image recognition unit 25 has an operation command determination unit 27. When a positive determination result is obtained by the third determination unit 26, the operation command determination unit 27 determines an operation command according to the shape and movement of the user's hand in the captured image. Yes. For the determination of the operation command, a table describing the correspondence between the hand shape or the change in the hand shape and the operation command may be used.

  Further, as shown in FIG. 3, the processing device 17 includes a gesture input unit 28 as a non-contact operation unit. The gesture input unit 28 is configured to input an operation signal corresponding to the operation command determined by the operation command determination unit 27 to the main body device 11.

  In this way, a basic non-contact operation is performed.

  In addition to such a basic configuration, in the present embodiment, means for preventing erroneous detection of the entry position of the foreign matter on the screen of the display unit of the main body device 11 as the operation position of the touch panel 1 is provided. Has been taken.

  That is, as shown in FIG. 3, the image recognition unit 25 includes a first determination unit 30 as a first determination unit. The first determination unit 30 includes an object having a size larger than a predetermined size that is regarded as a user's hand as an operation object for touch panel input in the captured image based on the captured image data. It is determined whether or not. The determination by the first determination unit 30 does not need to recognize the shape of the hand as in the determination by the third determination unit 26. Whether or not an object having a large size (number of pixels) has been detected may be used as a criterion. For example, the predetermined size may be 20 mm in diameter. The determination by the first determination unit 30 may be performed after confirming that the operation of the touch panel has been detected by the light shielding analysis unit 22.

  As shown in FIG. 3, the touch panel 1 has a control unit 32 as control means. According to the determination result of the first determination unit 30, the control unit 32 does not erroneously detect the entry position of the foreign object when the foreign object enters the screen of the display unit of the main body device 11 as the operation position of the touch panel 1. Therefore, the operation control of the touch panel 1 is performed.

  Specifically, in this embodiment, when a negative determination result is obtained by the first determination unit 30, the control unit 32 performs a touch panel analysis on the touch panel analysis unit 22 with respect to the coordinate detection unit 23. Even if an operation is detected, control is performed so that the operation position is not detected. On the other hand, when a positive determination result is obtained by the first determination unit 30, the control unit 32 causes the coordinate detection unit 23 to detect the operation position as usual.

  The control unit 32 may be configured by a CPU, a ROM, a RAM, and the like.

  According to such a configuration, even when a small foreign object enters the screen, a relatively large object that can be regarded as an operation object for touch panel input is detected in the captured image of the imaging area facing the screen. Based on whether or not the touch panel 1 is operated, the touch panel 1 can be controlled so as not to erroneously detect the entry position of the foreign matter on the screen as the operation position. That is, according to the present embodiment, erroneous detection can be effectively suppressed by cooperation with simple imaging technology / image processing technology.

  In particular, in the present embodiment, when an operation of the touch panel 1 is detected, it is confirmed that an object of a size that is regarded as an operation object for touch panel input is not detected in the captured image. Can be effectively suppressed.

(input method)
Next, a first embodiment of the input method according to the present invention to which the input device 10 of the first embodiment is applied will be described with reference to FIG.

  In the initial state of FIG. 4, it is assumed that both the gesture input unit 12 and the touch panel 1 are in the driving state (ON).

  Then, from the initial state, first, in step 1 (ST1) of FIG. 4, whether the operation of the touch panel 1 is detected by the image recognition unit 25 is determined based on the input signal from the light shielding analysis unit 22 or the light shielding analysis unit 22. Judgment is made based on the operating state (status bit, etc.) If a positive determination result is obtained in step 1 (ST1), the process proceeds to step 2 (ST2), and if a negative determination result is obtained, the process proceeds to step 5 (ST5).

  Here, the steps after step 2 (ST2) will be described first. First, in step 2 (ST2), the first determination unit 30 causes an object having a size greater than or equal to a predetermined size in the captured image. Whether or not is included is determined. When a positive determination result is obtained in step 2 (ST2), the process proceeds to step 3 (ST3), and when a negative determination result is obtained, the process proceeds to step 4 (ST4).

  When the process proceeds to step 3 (ST3), the normal operation position is detected by the coordinate detection unit 23, and the operation position detected by the coordinate input unit 24 with respect to the main body device 11 is set. The corresponding coordinates are input and the process is terminated.

  On the other hand, when the process proceeds to step 4 (ST4), the process is terminated without detecting the operation position by the control of the coordinate detection unit 23 by the control unit 32.

  Next, the steps after step 5 (ST5) will be described. First, in step 5 (ST5), the third determination unit 26 determines whether or not the hand shape is included in the captured image. To do. If a positive determination result is obtained in step 5 (ST5), the process proceeds to step 6 (ST6). If a negative determination result is obtained, the process returns to step 1 (ST1).

  Next, in step 6 (ST6), the operation command determining unit 27 determines an operation command corresponding to the shape of the hand detected in step 5 (ST5), and then the gesture input unit 28 uses the gesture command unit 28 to Then, an operation signal corresponding to the operation command determined in this manner is input, and the process is terminated.

(Second Embodiment)
(Input device)
Next, a second embodiment of the input device according to the present invention will be described with reference to FIG. 5 with a focus on differences from the first embodiment.

  For convenience, portions having the same or similar basic configuration as the first embodiment will be described using the same reference numerals.

  In the present embodiment, the determination by the first determination unit 30 is performed not only after the touch panel operation is detected by the light shielding analysis unit 22 as in the first embodiment but also before the touch panel 1 is driven (activated). It is like that. Then, when a negative determination result is obtained by the determination of the first determination unit 30 before driving the touch panel 1, the control unit 32 performs control not to drive the touch panel 1 as the IR driving unit 21. The light shielding analysis unit 22, the coordinate detection unit 23, and the coordinate input unit 24 are controlled to be in a non-driven state (in other words, a stopped state).

  On the other hand, the control unit 32 performs the first implementation when a negative determination result is obtained by the determination of the first determination unit 30 after the touch panel 1 is driven and the touch panel operation is detected by the light shielding analysis unit 22. Similar to the embodiment, the coordinate detection unit 23 is controlled not to detect the operation position.

  As shown in FIG. 5, in addition to the configuration of the first embodiment, the input device 10 in the present embodiment further includes a second determination unit 34 as a second determination unit. Have. The second determination unit 34 is controlled by the control unit 32 according to the positive determination result obtained by the first determination unit 30 before the touch panel 1 is driven (that is, each of the component units 21 to 21 described above). 24) after driving, it is determined based on the captured image whether or not the shape of the object having a size equal to or larger than the predetermined size detected by the first determination unit 30 has not changed for a predetermined time. It has become. The predetermined time may be, for example, 30 seconds.

  In the present embodiment, the control unit 32 stops driving the touch panel 1 when a positive determination result is obtained by the second determination unit 34.

  According to such a configuration, the operation of the touch panel 1 is in an undetected stage, an object having a size that is regarded as an operation object for touch panel input is not detected in the captured image, and the operation of the touch panel 1 is not performed. Under circumstances where it is apparent that the touch panel 1 is not operated, the intrusion of a foreign object can be prevented from being detected as an operation of the touch panel 1 by not driving the touch panel 1. Thereby, it can suppress further more effectively that the foreign material intrusion position is misdetected as an operation position. Furthermore, power consumption can be reduced and product life can be improved by preventing unnecessary driving of the touch panel 1. On the other hand, even when it is confirmed that an object of a size that is regarded as an operation object for touch panel input is not detected in the captured image after detecting the operation of the touch panel 1, by not detecting the operation position, False detection can be effectively suppressed.

(input method)
Next, a second embodiment of the input method according to the present invention to which the input device 10 of the second embodiment is applied will be described with reference to FIG.

  In the initial state of FIG. 6, it is assumed that the gesture input unit 12 is in a driving state (ON) and the touch panel 1 is in a non-driving state (OFF).

  Then, from the initial state, first, in step 11 (ST11) of FIG. 6, the first determination unit 30 determines whether or not an object having a predetermined size or larger is included in the captured image. To do. If a positive determination result is obtained in step 11 (ST11), the process proceeds to step 12 (ST12). If a negative determination result is obtained, the touch panel 1 is moved by the control unit 32. Return to step 11 (ST11) without driving.

  Next, in step 12 (ST12), the touch panel 1 is driven under the control of the control unit 32.

  Next, in step 13 (ST13), the image processing unit 25 determines whether an operation on the touch panel 1 is detected. If a positive determination result is obtained in step 13 (ST13), the process proceeds to step 2 (ST2) similar to the first embodiment, and if a negative determination result is obtained, step 14 (ST14).

  Since the processes after Step 2 (ST2) are the same as those in the first embodiment, the details are omitted.

  On the other hand, when the process proceeds to step 14 (ST14), the third determination unit 26 determines whether or not the hand image is included in the captured image. If a positive determination result is obtained in step 14 (ST14), the process proceeds to step 6 (ST6) similar to the first embodiment. If a negative determination result is obtained, step 14 is performed. 15 (ST15).

  Next, in step 15 (ST15), the second determination unit 34 determines whether the shape of the object in the captured image detected in step 11 (ST11) has not changed for a predetermined time. When a positive determination result is obtained in step 15 (ST15), the process proceeds to step 16 (ST16), and when a negative determination result is obtained, the process returns to step 13 (ST13).

  Next, in step 16 (ST16), the drive of the touch panel 1 is stopped under the control of the control unit 32, and the process returns to step 11 (ST11).

  In addition, this invention is not limited to embodiment mentioned above, You may change variously in the limit which does not impair the characteristic of this invention.

  For example, the present invention may be applied to a touch panel other than an optical touch panel.

  In particular, in the case of the optical touch panel 1, taking into account that foreign matter continues to adhere after intrusion, for example, a message for notifying the attachment of foreign matter after step 4 (ST4) in FIGS. May be displayed to prompt the user to remove the foreign matter.

DESCRIPTION OF SYMBOLS 1 Touch panel 10 Input device 11 Main body apparatus 16 Imaging camera 23 Coordinate detection part 30 1st determination part 32 Control part

Claims (10)

A touch panel having operation position detecting means for detecting the operation position on the screen of the display unit in the main unit as coordinates,
An input device capable of performing an input operation according to the operation position detected by the operation position detection unit on the main body device by the touch panel,
Imaging means for imaging a predetermined imaging area facing the screen;
First determination means for determining whether or not an object having a size equal to or larger than a predetermined size that is regarded as an operation object for touch panel input is included in the captured image based on a captured image of the imaging means; ,
Control means for controlling the operation of the touch panel so as not to erroneously detect the entry position of the foreign object as the operation position when a foreign object enters the screen according to the determination result of the first determination means. An input device characterized by that. When the negative determination result is obtained by the first determination unit, the touch panel operation control is not performed on the touch panel or even if the operation of the touch panel is detected. The input device according to claim 1, wherein the input position is control not to detect the operation position. When the operation control of the touch panel is a control that does not drive the touch panel, and the touch panel is driven by the control means in response to a positive determination result obtained by the first determination means. A second determination means for determining whether or not the shape of the object having a size equal to or larger than the predetermined size has not changed for a predetermined time based on the captured image;
The input device according to claim 2, wherein the control unit stops driving the touch panel when a positive determination result is obtained by the second determination unit. Third determination means for determining whether or not the shape of a predetermined operation object for non-contact operation is included in the captured image based on the captured image;
And a non-contact operation means for inputting an operation signal corresponding to the shape of the operation object to the main body device when a positive determination result is obtained by the third determination means. The input device according to any one of claims 1 to 3. The input device according to claim 1, wherein the operation object includes a user's hand. The input device according to any one of claims 1 to 5, wherein the touch panel includes an optical touch panel. An input method for detecting an operation position on the screen of the display unit in the main body device as coordinates using a touch panel and performing an input operation according to the operation position on the main body device,
A first step of imaging a predetermined imaging area facing the screen;
Based on the captured image captured in the first step, it is determined whether or not the captured image includes an object having a size greater than or equal to a predetermined size that is regarded as an operation object for touch panel input. Two steps,
A third step of controlling the operation of the touch panel so as not to erroneously detect the entry position of the foreign object as the operation position when a foreign object enters the screen according to the determination result in the second step; An input method characterized by including. In the third step, when a negative determination result is obtained in the second step, the touch panel is not driven, or the operation position is not detected even if the operation of the touch panel is detected. The input method according to claim 7, wherein the input method comprises: A fourth step of driving the touch panel in response to obtaining an affirmative determination result in the second step when the third step is a step of performing control without driving the touch panel;
A fifth step of determining whether or not the shape of an object having a size greater than or equal to the predetermined size has changed for a predetermined time after driving the touch panel in the fourth step, based on the captured image; ,
The input method according to claim 8, further comprising: a sixth step of stopping driving of the touch panel when a positive determination result is obtained in the fifth step. A seventh step of determining, based on the captured image, whether or not a shape of a predetermined operation object for non-contact operation is included in the captured image;
An eighth step of inputting an operation signal corresponding to the shape of the operation object to the main body device when an affirmative determination result is obtained in the seventh step. The input method according to claim 9.

Images