DE102017106263B4 - Input method for a touch-sensitive input device - Google Patents

Abstract

Input procedure comprising the following steps:
Providing an input device (1) having an input surface (8) and a scanner (2) which is designed to detect a touch of a finger on the input surface (8) to form a touch surface (11a, 11b) and an evaluation unit (3) to assign a control and/or switching function to a movement of the touch surface (11a, 11b) on the input surface (8);
Operation of the input device (1) in an identification mode in which a surface structure of the touch surface (11a, 11b) of the finger lying in the input surface (8) during contact is detected by means of the scanner (2) and evaluated by the evaluation unit (3) to generate biometric data;
Operation of the input device (1) in a first detection mode, in which a first partial area (9a) of the input surface (8) covered by the contact surface (11a, 11b) is detected several times completely or over its entire surface by means of the scanner (2) and associated first data are transmitted to the evaluation unit (3);
Operation of the input device (1) in a second detection mode, in which a second partial area (9b) of the input surface (8), each covered by the touch surface (11a, 11b), is detected several times completely or over its entire surface by means of the scanner (2) and associated second data are transmitted to the evaluation unit (3);
Evaluating the first data and second data by the evaluation unit (3) to obtain a first evaluation result and a second evaluation result in order to assign a control and/or switching function to the relative movement of the contact surface (11a, 11b) exclusively in the case of a predetermined minimum agreement between the first evaluation result and the second evaluation result, characterized in that
the evaluation unit (3) is located closest to the scanner (2) arranged, primary unit (3a) evaluating at least the first data and a secondary unit (3b) connected to the first unit (3a) via a data communication connection, evaluating at least the first data and superordinate to the primary unit (3a), and
that the secondary unit (3b) is designed to reset the primary unit if there is no minimum agreement between its evaluation result and the evaluation result of the primary unit (3a).

Description

The present invention relates to an input method for a touch-sensitive input device with an input surface and a scanner that is designed to detect a touch of the input surface. The input method and the input device are designed to detect the surface structure of a finger in an identification mode and to enable finger navigation, for example cursor control.

Various touch-sensitive input devices with associated input surfaces are known from the prior art, which are suitable for carrying out fingerprint recognition in at least a partial area of the input surface. Finger navigation then takes place in the remaining area of the input surface of the touch-sensitive input device.

The EP 1 947 590 B1 discloses a device for input and fingerprint recognition, wherein a first region and a second region of a touch surface are provided and fingerprint recognition takes place in the second region. A data processor is designed to selectively operate the touch surface in a touch input mode or in a fingerprint detection mode, hereinafter also called identification mode, wherein in the touch input mode the second region is operated at a resolution comparable to that of the first region in order to detect a touch input anywhere on the touch surface. In the fingerprint mode the data processor is configured to detect the second region at a higher resolution in order to detect a fingerprint on it.

From the US 2012/0105081 A1 An input method according to the preamble of claim 1 is known, namely that capacitive sensors can be able to determine the presence and location of a touch of a fingerprint pattern.

From the DE 100 04 965 A1 A device for the manual operation of devices in a vehicle is known, which is connected to the steering wheel and has control elements that enable two-dimensional movement and/or three-dimensional movement and activation on a display.

From the US 2003/0112226 A1 a touch sensitive detector comprises a detection surface and a conductive element and a first and second set of electrodes, each set of electrodes comprising at least one electrode extending parallel to the detection surface and each electrode being electrically insulated.

Especially when using an input device using finger navigation in a motor vehicle, there is a fundamental need to ISO 26262 The implementation of this standard is intended to ensure the functional safety of a system with electrical/electronic components in a motor vehicle. With the ever-increasing complexity of electronic components in vehicles, the possibility and risk of malfunctions also increases. If a safety-relevant component is affected by such a malfunction, in the worst case, people can be injured. Therefore, the ISO 26262 Safety objectives are defined. This means that suitable measures and processes must be applied to avoid systematic errors and appropriate additional product requirements must be implemented to control technical errors. It is difficult to meet these requirements in the case of an input device for finger navigation in a motor vehicle, since the available installation space, particularly in a motor vehicle steering wheel, prevents a completely redundant design of the input device; for example, redundant detection of the relatively small input area by several scanners is impossible anyway.

The object of the invention is therefore to provide an input method for a touch-sensitive input device that is suitable for enabling finger navigation reliably, i.e. with improved prevention of malfunctions, even in a small installation space and with a small input surface. This object is achieved by an input method according to claim 1 and by an input device according to the independent device claim. Advantageous embodiments are the subject of the dependent claims. It should be noted that the features listed individually in the patent claims can be combined with one another in any technologically reasonable manner and show further embodiments of the invention. The description, particularly in connection with the figures, additionally characterizes and specifies the invention.

According to the invention, an input device is provided. The input device has an input surface and a scanner. According to the invention, the scanner is aligned and designed such that it detects a touch of a finger on the input surface. The Fingers form a contact surface on the input surface. For example, an optical scanner, in particular an infrared scanner, is provided. In particular, the scanner has several sensor elements that form an array, preferably a two-dimensional array, which detects and thus defines the input surface. Preferably, the sensor elements can be evaluated individually and/or can be evaluated at least as a bundle and/or line-wise or column-wise. Preferably, according to the invention, a capacitive scanner, i.e. one that detects the input surface capacitively, is provided. For example, the scanning area and thus the input surface is determined by a two-dimensional array of measuring capacitors. Preferably, this is a capacitive fingerprint scanner, as is used, for example, in the DE 103 14 682 A1 is disclosed and the disclosure content of which is hereby included.

According to the invention, an evaluation unit is also provided in order to assign a control and/or switching function to a movement of the touch surface on the input surface. The evaluation unit is, for example, arranged at least partially immediately adjacent to the scanner.

The input method according to the invention is particularly suitable for input devices in which the scanning area and thus the input surface can be completely covered by a finger resting thereon, and in particular for input devices with an input surface of less than or equal to 2 cm ² , preferably less than or equal to 1.2 cm ² , even more preferably less than or equal to 0.25 cm ² . For example, the input surface is rectangular, oval or round.

The input method according to the invention provides for operation of the input device in an identification mode. In said identification mode, a surface structure of the touch surface of the finger lying in the input surface during contact is detected by the scanner and evaluated by the evaluation unit to generate biometric data. The data is stored, for example, in a non-volatile memory.

Furthermore, according to the invention, the input device is operated in a first detection mode in which a first partial area of the input surface covered by the touch surface is detected several times completely or over its entire surface by means of the scanner and associated first data are transmitted to the evaluation unit.

According to the invention, the input device is operated in a second detection mode, in which a second partial area of the input surface, each covered by the touch surface, is detected several times completely or over its entire surface by means of the scanner and associated second data is transmitted to the evaluation unit. The operation in the first and second detection modes is carried out, for example, simultaneously or intermediately.

In an evaluation step following each of the recording steps, the first data and second data are evaluated by the evaluation unit to obtain a first evaluation result and a second evaluation result, so that a control and/or switching function is assigned to the relative movement of the contact surface only if there is a predetermined minimum agreement between the first evaluation result and the second evaluation result.

“Full-area detection” in the sense of the invention means the complete detection of a connected partial area, for example by evaluating all of the scanner’s sensor elements assigned to the respective partial area and arranged adjacent to one another. “Complete detection” in the sense of the invention means the detection of a partial area that is not necessarily connected, which is formed, for example, from segments or individual sensor elements that are distributed over the input area.

The evaluation is carried out, for example, using an image comparison method, such as a differential image comparison method or an image correlation method, in which at least two images or partial images of the respective sub-area taken one after the other are evaluated or compared with one another. "Image" or "images" in the sense of the invention does not necessarily imply an optical detection of the respective sub-area, but is to be interpreted broadly and means a related detection of all sensor elements of the scanner assigned to the respective sub-area, for example in the form of a measured value matrix. The changes in the position of at least one characteristic point or a characteristic structure of the detected surface structure within the sub-area are assigned a relative movement, which in turn is converted into a control and/or switching function.

The functional reliability can be increased by the operation of the input device which evaluates different parts of the input surface.

According to a preferred embodiment of the input method, the first sub-area and the second sub-area are not arranged so as to overlap, i.e. are arranged spatially separated from each other. This achieves improved verification, since the detection is carried out by spatially different Areas of the input surface of the scanner and thus through different sensor elements and also the detection takes place on different structures of the surface structure of the finger.

According to the invention, the evaluation unit is hierarchically constructed and has a primary unit assigned to the scanner, also called a sensor controller, which evaluates at least the first data, and a secondary unit, also called a host controller, which communicates with the first unit via a data communication connection, preferably a bidirectional and/or encrypted data communication connection, evaluates at least the first data and is superior to the primary unit. This achieves improved verification. For secure verification, both the first and the second data are evaluated by the primary unit as well as the secondary unit. In a further simplified embodiment, the first data is evaluated exclusively by the primary unit and the second data is evaluated exclusively by the secondary unit.

According to a preferred embodiment, the primary and/or secondary unit are functionally monitored. For example, the primary and/or secondary unit has an A/D converter, for the purpose of monitoring its function, a predetermined reference voltage is converted by the converter and thus digitized, and the associated digital value is compared with the value corresponding to the predetermined reference voltage. If there is insufficient agreement, a malfunction of the primary unit is diagnosed by the secondary unit and assignment to a switching or control function is prevented.

According to the invention, the secondary unit is designed to reset the primary unit if there is no minimum agreement between its evaluation result and the evaluation result of the primary unit.

Preferably, the input device is operated simultaneously in the first detection mode and the second detection mode, in other words, the first data and second data are detected by simultaneously detecting the first and second partial areas, respectively. However, embodiments are conceivable in which the first and second data are generated in chronological order by a sequence of detection steps.

According to a preferred embodiment, the evaluation of the first and second data is carried out by the evaluation unit using different algorithms. For example, the first data is determined using a differential image comparison method and the second data is determined using an image correlation method. In order to achieve a high level of verification and a high degree of functional monitoring, both the first data and the second data are evaluated using the different algorithms.

According to a preferred embodiment, the assignment to a control and/or switching function is additionally verified using the biometric data obtained in identification mode. In other words, the assignment only takes place if there is a minimum match between the biometric data determined in identification mode and the stored biometric data.

The two detection modes are used in particular to evaluate comparatively slow movements of the finger across the scanning area. For example, these are carried out if the surface structure and thus the contact surface does not exceed an average speed relative to the input surface of 400 mm/s, preferably 200 mm/s.

In one embodiment of the method, the first sub-area is located in the center of the input area, i.e. centrally and surrounded by other areas of the input area. Particularly preferably, the sensor elements assigned to this area are evaluated individually in the first sub-area. The first sub-area is designed in such a way that a surface structure of a finger can be reliably detected.

According to this embodiment, the second sub-area is provided within the edge area adjacent to the first sub-area.

According to a preferred embodiment, the scanner has an array of sensor elements, which are selected depending on the input mode in order to be assigned to the first sub-area or the second sub-area.

The input method according to the invention and the input device according to the invention are preferably suitable for use in a motor vehicle, in particular as a component of a steering wheel, for example as a multifunctional input device which is at least partially integrated into a spoke of a steering wheel.

• 1 eine Ausführungsform der erfindungsgemäßen Eingabevorrichtung, wie sie zur Durchführung des erfindungsgemäßen Eingabeverfahrens verwendet wird;
• 2 eine Detailansicht der erfindungsgemäßen Eingabevorrichtung.

The invention is explained in more detail with reference to the following figures. The figures are to be understood as examples only and merely represent preferred embodiments. They show:

• 1 an embodiment of the input device according to the invention, as used to carry out the input method according to the invention;
• 2 a detailed view of the input device according to the invention.

The input device 1 according to the invention, as shown in 1 shown, is characterized in that it is designed to carry out the input method according to the invention. The input device 1 is at least partially integrated into a steering wheel 10 of a motor vehicle, in particular the spoke of a steering wheel 10 of a motor vehicle. The input device 1 has a scanner 2 and an associated input surface 8. The input surface 8 is part of the surface of the spoke of the steering wheel 10. In the 1 The scanner 2 is arranged below the input surface 2. The scanner 2 is aligned so that its detection area, also called scanning area, detects the input surface 8 in such a way that touches of a finger on the input surface 8 can be detected. This contact by the finger (not shown in detail) forms a contact surface 11a, 11b, whereby in the 1 two different contact situations, namely 11a and 11b, are shown as they occur in chronological order as a respective snapshot when the finger slides over the input surface 8. The size relationships shown between the contact surfaces 11a, 11b and the input surface 8 are not to scale and are intended for illustrative purposes only. It should be clear to the person skilled in the art that the respective extent of the contact surface 11a or 11b will also vary greatly with the contact pressure applied during contact. The scanner 2 is, for example, and not necessarily, a capacitive scanner. The scanner 2 has an array of sensor elements that can be evaluated individually in order to be able to detect the input surface 8 with regard to contact. The scanner 2 is connected to an evaluation unit 3 by means of a line 6. The evaluation unit 3 is hierarchically structured and comprises a primary unit 3a, which is integrated into the spoke of the steering wheel 10 and a secondary unit 3b, which is outside the steering wheel 10 but nevertheless within the 1 not shown in more detail. The primary unit 3a, which is arranged closest to the scanner 2, is connected to the secondary unit 3b via a data communication line 4. The data communication is encrypted and bidirectional as indicated by the arrow 5. For example, the data communication between the primary unit 3a and the secondary unit 3b is designed to initiate a reset of the primary unit 3a triggered by the secondary unit 3b if a malfunction of the primary unit 3a is detected by the secondary unit 3b. To monitor the function of the primary unit 3a, in particular of the A/D converter integrated therein for evaluating the first or second data supplied by the scanner 2, a separately generated analog signal 7 with a predetermined level is fed to it in order to enable or ensure function monitoring of the primary unit 3a based on the associated converted signal.

The input method includes operating the input device 1 in an identification mode (not explained in more detail), which involves detecting a surface structure of the touch surface 11a, 11b of the finger lying in the input surface during contact in order to obtain biometric data therefrom, which are used to identify the operator. These methods are generally known and this identification mode is one of the operating modes of the input device 1 according to the invention. This identification mode is selected selectively, for example, and a substantially stationary touch surface is assumed during operation in the identification mode.

According to the invention, a first detection mode is also provided, which is described based on the current contact situation, as represented by the contact surfaces 11a and 11b. For this purpose, the input surface 8 has a first partial area 9a and a second partial area 9b located outside the first partial area 9a, which are each determined by selectively selecting a subset of sensor elements that belong to the array of sensor elements as defined by the scanner 2.

The first partial area 9a and the second partial area 9b each form a connected area and are simultaneously recorded multiple times in the respective recording mode, i.e. in the first recording mode and in the second recording mode, over the entire area, i.e. completely encompassing this first 9a and second partial area 9b, and the associated data, i.e. first data or second data, are transmitted to the evaluation unit 3. The aim of the recording modes from the first and second recording mode is to record a movement of the contact surface 11a, 11b in the first partial area 9a and the second partial area 9b, which is spatially separated from the first partial area 9a, from the sequence of recording data (images) from the first and second data.

The first and second data thus obtained independently are each processed by both the primary unit 3a and the secondary unit 3b of the evaluation unit 3 using two different algorithms, for example an absolute or a differential image evaluation method, which are described in 2 through the different image patterns in the Partial areas 9a, 9b are indicated schematically. In a simple embodiment of the method according to the invention, the first data belonging to the first partial area are each evaluated by the primary and secondary unit using only one of the algorithms. For example, the algorithms are used in a distributed manner on the primary or secondary unit depending on the required computing effort.

However, an embodiment is conceivable in which the first data and second data are evaluated by the primary unit 3a and the secondary unit 3b using both algorithms in order to achieve a high degree of verification. Only if there is a predetermined minimum agreement between the evaluation results determined by the evaluation unit, for example in a predetermined time interval, is a switching or control function, such as cursor control, assigned to the detected movement. The aim of detecting the movement of the touch surface 11a, 11b through spatially separated sub-areas, evaluating the data obtained in this way using different algorithms and through a hierarchically structured evaluation unit consisting of a primary and secondary unit, which verify each other, results in a high degree of functional control of the generic input device. According to a preferred embodiment, the aforementioned assignment is additionally verified by the biometric data obtained in identification mode, i.e. the assignment only takes place if the biometric data determined in identification mode have a sufficient match with stored data, so that an assignment is only carried out if the input can be verified by the stored biometric data.

Claims (10)

Input method, comprising the following steps: providing an input device (1) comprising an input surface (8) and a scanner (2) which is designed to detect a touch of a finger on the input surface (8) to form a touch surface (11a, 11b), and an evaluation unit (3) to assign a control and/or switching function to a movement of the touch surface (11a, 11b) on the input surface (8); operating the input device (1) in an identification mode, in which a surface structure of the touch surface (11a, 11b) of the finger lying in the input surface (8) during the touch is detected by means of the scanner (2) and evaluated by the evaluation unit (3) to generate biometric data; Operation of the input device (1) in a first detection mode, in which a first partial area (9a) of the input area (8), each covered by the touch area (11a, 11b), is detected several times completely or over its entire surface by means of the scanner (2) and associated first data are transmitted to the evaluation unit (3); Operation of the input device (1) in a second detection mode, in which a second partial area (9b) of the input area (8), each covered by the touch area (11a, 11b), is detected several times completely or over its entire surface by means of the scanner (2) and associated second data are transmitted to the evaluation unit (3); Evaluating the first data and second data by the evaluation unit (3) while obtaining a first evaluation result and a second evaluation result in order to assign a control and/or switching function to the relative movement of the contact surface (11a, 11b) exclusively if there is a predetermined minimum match between the first evaluation result and the second evaluation result, characterized in that the evaluation unit (3) comprises a primary unit (3a) arranged closest to the scanner (2) which evaluates at least the first data and a secondary unit (3b) which is connected to the first unit (3a) via a data communication connection, evaluates at least the first data and is superior to the primary unit (3a), and in that the secondary unit (3b) is designed to reset the primary unit if there is no minimum match between its evaluation result and the evaluation result of the primary unit (3a). Input method according to the preceding claim, wherein the first partial area (9a) and second partial area (9b) are not arranged to overlap. Input method according to one of the preceding claims, using an input area (8) of less than or equal to 2 cm ² , preferably less than or equal to 1.2 cm ² , even more preferably less than or equal to 0.25 cm ² . Input method according to the preceding claim, wherein the primary unit (3a) and/or the secondary unit (3b) are function-monitored. Input method according to one of the preceding claims, wherein the scanner (2) defines an array of sensor elements. Input method according to one of the preceding claims, wherein the input device (1) is operated simultaneously in the first detection mode and the second detection mode. Input method according to one of the preceding claims, wherein the evaluation unit (3) evaluates the first and second data according to different algorithms. Input method according to one of the preceding claims, wherein the assignment to a control and/or switching function is additionally verified by the evaluation unit (3) on the basis of the biometric data obtained in the identification mode. Input device (1) for finger navigation, comprising an input surface (8) and a scanner (2) which is aligned and designed to detect a touch of a finger on the input surface (8) to form a touch surface (11a, 11b), and an evaluation unit (3) to assign a control and/or switching function to a movement of the touch surface (11a, 11b) on the input surface (8); wherein the input device (1) is designed to carry out an input method according to one of the preceding claims. Steering wheel (10) for a motor vehicle with an input device (1) according to the preceding claim.

Images